Jae Bae - Data Engineer

Jae Bae

Data Engineer

San Jose, California, United States

Join Prog.AI to see contacts

Summary

👤

Senior

🎓

Top School

Jae Bae is a seasoned data engineer with 13 years building large-scale analytics and experimentation platforms for companies like Apple, Robinhood, Netflix, Uber, and Facebook. He has deep end-to-end expertise in data modeling, real-time and batch pipelines, storage engines (including pioneering Elasticsearch and Druid adoption), and orchestration with Spark, Flink, Kafka, and Airflow. As a technical lead he has driven AB-testing and assignment systems, rule engines, and metrics optimization, combining hands-on implementation with platform design. An active open-source contributor, he has improved Apache Druid’s S3 and credentials integrations and helped evolve Netflix’s Suro pipeline, underscoring a focus on reliable external service integration. Based in San Jose, he blends low-level systems experience (search engines and C++ early in his career) with modern cloud-native analytics to deliver resilient, production-grade data systems.

13 years of coding experience

18 years of employment as a software developer

Master's Degree, Computer Science, Master's Degree, Computer Science at The University of Texas at Austin

Bachelor of Science, Computer Science, Bachelor of Science, Computer Science at Korea Advanced Institute of Science and Technology

Korean

Stackoverflow

Stats

1reputation

0reached

0answers

0questions

Github Skills (21)

data-pipelines10

apache-druid10

apache-curator10

java10

javas10

aws10

amazon-s310

aws-s310

file-handling10

data-pipeline10

s3-bucket10

elasticsearch-curator10

elasticsearch8

file-processing8

elasticsearch-api8

Programming languages (3)

JavaScalaPython

Github contributions (5)

Netflix/suro

Apr 2013 - Apr 2015

Netflix's distributed Data Pipeline

Role in this project:

Back-end Developer

Contributions:278 commits, 35 PRs, 44 pushes in 1 year 11 months

Contributions summary:Jae's contributions focused on modifying and improving the `LocalFileSink` and `S3FileSink` classes, core components within the data pipeline. The primary changes involved refactoring code, switching from the `notify` method to the `notice` method to send messages to the queue. The updates also include changes to use `MessageWritable` to pass messages, improving durability, and modifications to the `ElasticSearchSink` class. The code also suggests improvements to the underlying data handling processes.

stream-processingpipelinenetflixdata-sciencebig-data

apache/druid

Jan 2014 - Jul 2014

Apache Druid: a high performance real-time analytics database.

Role in this project:

Back-end Developer

Contributions:8 commits, 1 comment in 6 months

Contributions summary:Jae contributed to enhancements in the Apache Druid project, focusing on curator library updates and S3 extension improvements. Their work included upgrading curator versions and incorporating logging for service reinstatement processes. Furthermore, they developed and refactored code related to AWS credentials handling, introducing a file-based session credentials provider and adapting S3 service interactions. These changes demonstrate a focus on improving Druid's integration with external services and ensuring reliability.

real-timebig-datadruiddatabasehadoop

Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.

Request Free Trial