Edgar Rodriguez-diaz
Senior Staff Software Engineer at Airbnb
United States
Summary
🤩
Rockstar🎓
Top SchoolEdgar Rodriguez-diaz is a Senior Staff Software Engineer with 16 years of experience building scalable, stable infrastructure for AI, big data, and knowledge-graph systems. At Airbnb he’s driven architecture and delivery for petabyte-scale data pipelines and AI-focused data infrastructure, combining deep expertise in distributed systems, semantic technologies, and algorithmic design. He has a track record of shipping production-grade back-end improvements to major open-source projects like Apache Iceberg and Airflow, including ORC integration for Spark and robustness fixes for job scheduling. Edgar pairs an MS in Intelligent Systems with hands-on engineering across graph databases and data integration, bridging research-grade ideas into operational systems. Colleagues describe him as a pragmatic architect who balances elegant design with measurable performance and maintainability gains.
16 years of coding experience
12 years of employment as a software developer
Master of Science (MS) Computer Science Intelligent Systems AI, Master of Science (MS) Computer Science Intelligent Systems AI at Tecnológico de Monterrey
English, Spanish, German
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (16)
javas10
apache-airflow10
apache-spark10
orchestration10
workflow-engine10
backend10
python10
orc10
java10
apache-iceberg10
data-engineering10
automations8
automation8
sql8
indexer7
Programming languages (6)
Github contributions (5)
apache/iceberg
May 2019 - Jul 2022
Apache Iceberg
Role in this project:
Back-end Developer
Back-end DeveloperContributions:25 reviews, 20 commits, 24 PRs in 3 years 2 months
Contributions summary:Edgar contributed to the Apache Iceberg project by implementing ORC read integration for Spark 2.4.0, adding ORC support for listPartitions, and refactoring metrics tests for reuse. Their work included modifying core and Spark components to incorporate ORC-specific metrics and functionality. These changes enhance Iceberg's ability to work with ORC file formats within a Spark environment, focusing on data access and metadata handling.
apache-icebergapachebig-datadatastreamjava
apache/airflow
Jul 2017 - Apr 2018
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Role in this project:Backend Developer
Backend DeveloperContributions:19 PRs, 72 comments in 9 months
Contributions summary:Edgar primarily contributed to refactoring and enhancing the Apache Airflow codebase, focusing on core backend functionalities. They implemented changes to the `BackfillJob` class, breaking down complex methods and introducing a status object for better job tracking. Further contributions included addressing issues related to maximum active runs, handling variable decryption errors, and adding an index to the `job_id` column. These changes aimed to improve the robustness, maintainability, and performance of the Airflow workflow management system.
monitorpythonschedulerapacheprogrammatically
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.