Diego Lopes
Lead Data Engineer
São Paulo, Brazil
Summary
👤
Senior🎓
Top SchoolDiego Lopes is a Lead Data Engineer based in São Paulo with 9 years of experience designing and operating large-scale, mission-critical data platforms across cloud and on-prem environments. He has deep expertise in distributed databases and lakehouse architectures—having built a 12-node Cassandra cluster processing billions of writes and architected S3+Iceberg analytics with Trino federation for low-latency cross-store queries. Diego blends hands-on engineering with research: alongside industry roles he is fine-tuning Transformer-based LLMs to translate geospatial natural language into PostGIS SQL, bridging NLP, GIS and production databases for Brazilian Portuguese. He consistently delivers reliability (99.99% availability at Pulsus), exactly-once pipelines, and pragmatic metadata governance to speed data discovery and reduce downstream errors. Colleagues know him for translating ambiguous business needs into robust data models and for tooling platforms that enable fast, auditable ML feature engineering.
9 years of coding experience
5 years of employment as a software developer
Master's degree Computer Science Artificial Intelligence, Master's degree Computer Science Artificial Intelligence at USP - Universidade de São PauloPostgraduate Degree Digital Security Governance and Data Management, Postgraduate Degree Digital Security Governance and Data Management at Pontifícia Universidade Católica do Rio Grande do SulInstituto Federal de Educação, Ciência e Tecnologia de São Paulo
English, Portuguese, Italian
Stackoverflow
234reputation
22kreached
7answers
0questions
Github Skills (27)
monitor10
python10
data-science10
data-engineering10
machine-learning10
apache10
scheduler10
etl10
automation10
mlops10
orchestration10
data-pipelines9
apache-airflow9
workflow-engine9
elt9
Programming languages (2)
Github contributions (5)
lopesdiego12/portfolio
May 2020 - May 2022
Contributions:47 commits, 42 pushes, 1 branch in 2 years
lopesdiego12/Apache-Airflow
May 2020 - Feb 2021
Contributions:32 commits, 31 pushes, 1 branch in 9 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.