Giulio Carvalho
Data Specialist
Pernambuco, Brazil
Summary
🤩
Rockstar🎓
Top SchoolGiulio Carvalho is a data specialist with nine years of experience building cloud-native data platforms and civic technology projects in Brazil. He designs and implements GCP-based data infrastructure and pipelines to support government analytics and more sustainable public procurement, and previously led data scraping teams that delivered large-scale collection systems using Scrapy, Docker and AWS. At Open Knowledge Brasil he managed flagship civic tech FOSS projects like Querido Diário (making Brazilian government gazettes accessible) and coordinated a 150+ person civic innovation network, blending technical leadership with community building. Comfortable moving between hands-on engineering and program management, he brings practical expertise in scraping, data quality, CI/CD and project lifecycle from proposal to maintenance. An engineer from Universidade Federal de Pernambuco, he pairs a strong technical toolkit with a track record of translating messy government data into actionable public-interest insights.
9 years of coding experience
7 years of employment as a software developer
Undergraduate, Computer Engineering, Undergraduate, Computer Engineering at Universidade Federal de Pernambuco
Github Skills (8)
data-extraction10
scrapy10
spider10
python10
webscraping10
crawling10
open-data9
data-science8
Programming languages (10)
Github contributions (5)
okfn-brasil/querido-diario
Apr 2020 - Dec 2022
📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian government gazettes, accessible to everyone.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:241 reviews, 81 commits, 98 PRs in 2 years 8 months
Contributions summary:Giulio contributed significantly to the `querido-diario` repository, a project focused on scraping and making accessible Brazilian government gazettes. Their work involved developing spiders to extract data from specific gazette websites, particularly focusing on the Recife (PE) gazette. They addressed challenges related to cookie handling, request throttling, and attachment downloads, implementing pipelines and custom settings to ensure data extraction. The user also implemented pagination and extra editions for gazette data.
pythoncivic-techdata-sciencegazette-crawlerspider
okfn-brasil/diarios-do-clima-frontend
Mar 2023 - Dec 2024
Repositório para o frontend (interface web) do Diários do Clima.
Contributions:4 reviews, 15 PRs, 54 pushes in 1 year 9 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.