Mauricio De Diana
Backend Data Engineer
São Paulo, Brazil
Summary
👤
Senior🎓
Top SchoolMauricio De Diana is a Backend Data Engineer with 12 years of experience building data-intensive, large-scale web systems from São Paulo. He specializes in designing resilient ETLs, Kafka consumers, and backend APIs, and has a strong track record reducing operational cost and complexity—most notably shrinking an Elasticsearch footprint by half through pre-aggregation and Redis/Postgres redesign. At Lucid and Monte Carlo he owned Airflow orchestration, Spark jobs, GDPR-safe data deletion, and both self-managed and AWS-managed data infrastructure. He contributes to Apache Airflow, improving CLI testing and logging and adding multi-date next_execution functionality, showing attention to developer experience in a widely used open-source project. Comfortable across Python, Go, and cloud services, he pairs hands-on implementation with product-facing work such as building sales-facing admin tools and integrations with multiple external data providers. Collected experience from startups to large teams and research labs gives him a pragmatic blend of systems performance tuning and data-product design.
12 years of coding experience
15 years of employment as a software developer
Bachelor of Engineering (BEng), Electrical Engineering - Area of Concentration: Computers, Bachelor of Engineering (BEng), Electrical Engineering - Area of Concentration: Computers at Escola Politécnica da USPMaster of Science (M.Sc.), Computer Science, Master of Science (M.Sc.), Computer Science at Instituto de Matemática e Estatística - Universidade de São Paulo (IME-USP)
English
Stackoverflow
129reputation
14kreached
4answers
0questions
Github Skills (20)
data-pipelines10
python10
data-engineering10
testing10
workflow-engine10
scheduler10
airflow10
orchestration10
data-pipeline10
cli10
cicd9
devops9
automation9
automations9
gcp8
Programming languages (4)
Github contributions (5)
apache/airflow
May 2020 - Jul 2020
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Role in this project:
Backend & DevOps Engineer
Backend & DevOps EngineerContributions:9 PRs, 28 comments in 1 month
Contributions summary:Mauricio primarily contributed to improving the testing framework and functionality of the Airflow CLI, focusing on the `next_execution` command by making tests more efficient and readable. They also added functionality to the `next_execution` command by allowing the display of multiple execution dates. Additionally, the user refactored the logging system to support external log links and updated the StackdriverTaskHandler for GCP credentials.
monitorpythonschedulerapacheprogrammatically
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.