Eren Avşaroğulları
Principal Software Engineer Workday Data Analytics (Apache Spark Platform Team)
San Francisco, California, United States
Summary
🤩
Rockstar🎓
Top SchoolEren Avşaroğulları is a Principal Software Engineer with 13 years of experience building and optimizing large-scale distributed data platforms, currently leading Spark runtime and observability improvements for Workday Prism Analytics in San Francisco. He specializes in Spark query compilation, adaptive query execution, memory management, disk spilling, shuffle tuning and performance/scalability hardening, and has led progressive Spark upgrades that keep Prism’s analytics backbone current. An active Apache contributor, Eren has made substantive backend changes to flagship projects like Apache Spark (scheduler robustness and SQL REST API support), DataFusion (array function porting), Pulsar and Heron, blending OSS impact with production-grade engineering. Comfortable across Scala, Java and Rust and orchestration tech like Kubernetes and AWS, he pairs deep systems-level knowledge with hands-on ETL and pipeline work. Less obvious: his contributions emphasize rigorous test coverage and scheduler resiliency, reflecting a pragmatic focus on stability under heavy, real-world workloads.
13 years of coding experience
12 years of employment as a software developer
Bachelor's degree Electrical & Electronic Engineering Department, Bachelor's degree Electrical & Electronic Engineering Department at Karadeniz Technical UniversityMaster's degree Control & Automation Engineering Department, Master's degree Control & Automation Engineering Department at Istanbul Technical University
Github Skills (27)
unit-testing10
spark10
apache-flink10
messaging10
big-data10
flink-sql10
java10
scala10
apache-arrow10
javas10
heron10
junit10
sql10
event-streaming10
jtest10
Programming languages (3)
Github contributions (5)
apache/incubator-heron
Nov 2017 - Nov 2018
Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter
Role in this project:
Back-end Developer & QA Engineer
Back-end Developer & QA EngineerContributions:34 commits, 30 PRs, 92 comments in 1 year
Contributions summary:Eren primarily focused on extending the test coverage for the LocalFileSystemUploader component, indicating a focus on backend development related to file upload functionality within the Heron framework. The user added new tests to cover various scenarios, including those related to default file system directory usage, handling existing topology files, and invalid file system directory configurations, which demonstrate a focus on thorough testing and code robustness. The user also contributed to testing utilities within the SPI, demonstrating involvement in the broader testing infrastructure of the project.
fault-tolerantrealtimedata-streamfaultstream
apache/spark
May 2015 - Nov 2024
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:Back-end Developer
Back-end DeveloperContributions:30 reviews, 17 PRs, 167 comments in 9 years 7 months
Contributions summary:Eren primarily contributed to the core backend of the Apache Spark project by modifying core scheduler components. Their work involved enhancing the `TaskState` and `TaskSetManager` classes, ensuring unique naming for `TaskSetManager`, and improving the handling of invalid data access within the scheduler. These changes included adding new unit tests and handling potential exceptions related to file access, which improved the stability and robustness of the Spark scheduler. The user also added support for the SQL REST API in the Spark project.
analyticspythondata-processingsqlapache
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.