- Challenge 1: how to find the most effective specification format to be exchanged by the domain experts with the database/application developers.
- Challenge 2: the open data is made available on a yearly basis by the Brazilian government and we have no control over the provided data sources. This means that we had to handle schema and data evolution
- Challenge 3: having time constraints in mind, how to choose the most appropriate data model, with less impact on query development and still obtaining performance.
- Challenge 4: how to couple the query development with a REST API, since the main goal was to make the data easily available.
- Challenge 5: how to develop an attractive front-end on a fast way.
We have learned and we are still learning several lessons on developing this project, going from human to technological ones. We can assure that developing a complete Open Government Data initiative is a very complex task, which would be hard to be provided by isolated experts in the field or data scientists. The main computational difficulty is not to provide a single metric or indicator, which is doable with lesser development efforts (of course there is a huge effort from the domain experts to choose and organize the best indicators), but to keep a continuous pace on delivering new indicators with very large amounts of data, and updating them every time a new data release is available. The work, as seen in the screenshot below, is also available at https://dadoseducacionais.c3sl.ufpr.br/#/indicadores/