João Medeiros
Data Engineer
São Paulo, Brazil
Summary
👤
Senior🎓
Top SchoolJoão Medeiros is a data-focused Software Engineer with 11 years of experience building scalable backend systems, currently working as a Data Engineer in São Paulo. He specializes in Python and Django, has deep expertise in databases and cloud platforms (GCP/AWS), and repeatedly optimizes large data pipelines—once cutting a parquet import from two hours to under 40 minutes. João has led small teams at startups, architected early-stage products that generated substantial revenue for insurance and M&A use cases, and improved operational efficiency through pragmatic DevOps choices like BuildKit and Kubernetes autoscaling. A lifelong tinkerer who started with Linux and a tech blog as a teen, he brings both hands-on engineering and an appetite for learning new languages and contributing to open-source tooling. Notably, he has solved hard distributed-systems problems—designing Kafka/Cassandra crawlers and a failover algorithm that eliminated daily crawl failures—demonstrating reliability under high data volumes.
11 years of coding experience
10 years of employment as a software developer
Federal University of Rio Grande do Norte
English, Portuguese
Github Skills (76)
sink10
cosmosdb10
gcp10
kafka-connect10
jms10
cassandra10
mongodb10
rethinkdb10
lenses10
architecture9
kafka-streams9
ftp9
django9
django-rest9
dataops9
Programming languages (8)
Github contributions (5)
joaomedeiros95/django-davinci-crawling
Oct 2019 - Mar 2020
A Crawling Framwework on top of Caravaggio REST API
Contributions:1 PR, 121 pushes, 25 branches in 5 months
apireston-topcrawlerframwework
Processos-de-software-2016-2/python-api
Oct 2016 - Dec 2016
Contributions:46 PRs, 79 pushes, 43 branches in 1 month
rest-apiapipythonpython3
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.