Principal Staff Software Engineer, Big Data Pipelines & Platform Infrastructure
Pacifica, California, United States
Join Prog.AI to see contacts
Join Prog.AI to see contacts
Summary
🤩
Rockstar
🎓
Top School
Byron Ellis is a Principal Staff Software Engineer with 13 years building large-scale distributed data platforms, currently focusing on big data pipelines and platform infrastructure at LinkedIn. He blends deep statistical training (PhD in Statistics from Harvard) with hands-on systems engineering, having led BigQuery Engine work for Apache Flink and BigQuery Storage and metadata initiatives at Google. An Apache Beam committer and contributor to its Java SDK and I/O transforms, he brings production-hardened open-source experience to complex streaming and batch systems. Byron’s background spans leadership roles from CTO to senior engineering manager, driving trust & safety analytics, fraud detection, and ML-driven optimization in high-throughput environments. Based in Pacifica, CA, he is as comfortable architecting low-latency data flows as he is mentoring cross-functional teams to operationalize models. A practical scientist at heart, he often surfaces subtle schema and reliability issues in production data pipelines before they become outages.
13 years of coding experience
21 years of employment as a software developer
PhD Statistics, PhD Statistics at Harvard University
University of California, Los Angeles
Exchange Scholar Statistics, Exchange Scholar Statistics at Stanford University
Apache Beam is a unified programming model for Batch and Streaming data processing.
Role in this project:
Back-end Developer
Contributions:24 reviews, 3 commits, 17 PRs in 6 months
Contributions summary:Byron primarily focused on improving the stability and functionality of the Apache Beam Java SDK. They addressed flakiness in Spanner I/O write tests by adjusting retry logic and formatting comments. Additionally, the user implemented a JDBC schema transform, including configuration updates and validation, along with adding documentation and resolving minor formatting issues. Further contributions involved schema generation fixes for BigQuery, specifically detecting and handling potential schema collisions during Avro conversion.
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Byron Ellis - Principal Staff Software Engineer, Big Data Pipelines & Platform Infrastructure