A Zur
Big Data Principal Engineer
Tel Aviv-Yafo, Tel Aviv District, Israel
Summary
👤
SeniorAviem Zur is a Big Data Principal Engineer with 11 years of experience, currently leading data platform efforts at Natural Intelligence from Tel Aviv. He is a long-standing Apache PMC member for Apache Beam, contributing notable serialization, Spark runner unification, and Kafka IO metrics work to a widely used batch-and-stream processing framework. Aviem focuses on data frameworks, platform engineering and quality, blending deep backend systems expertise with open source stewardship. His background includes production roles at PayPal and ad-tech firms, and an early systems foundation from Unit 8200, which informs his pragmatic approach to scalable, observable data systems. Outside of engineering he’s an active open-source contributor and a Magic: The Gathering enthusiast, a hobby that reflects his strategic and analytical mindset.
11 years of coding experience
13 years of employment as a software developer
English, Hebrew
Stackoverflow
171reputation
24kreached
6answers
0questions
Github Skills (18)
data-serialization10
java10
serialization10
javas10
kryo10
apache-beam10
spark9
kafka9
data-processing8
metric8
streaming7
elasticsearch6
future6
spark-streaming6
scala6
Programming languages (9)
Github contributions (5)
apache/beam
Aug 2016 - Aug 2017
Apache Beam is a unified programming model for Batch and Streaming data processing.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:98 commits, 80 PRs, 624 comments in 1 year
Contributions summary:A primarily contributed to the AvroCoder serialization process by modifying its behavior to support Kryo serialization, indicating a focus on data serialization and optimization within the Apache Beam framework. Their work involved code changes to the AvroCoder class, including the introduction of caching mechanisms for binary encoders and decoders, and adding Kryo serialization support in tests. Furthermore, the user unified and improved Spark runner functionality, specifically targeting the unification of the EvaluationContext and StreamingEvaluationContext to enhance the Spark runner's streaming capabilities. Additionally, the user implemented IO metrics for the KafkaIO, indicating a focus on monitoring and improving IO performance.
golangpythonstreaming-databeambatch
plaintextoffenders/plaintextoffenders
Apr 2018 - May 2021
https://plaintextoffenders.com offenders list
Contributions:112 commits, 5 PRs, 100 pushes in 3 years 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.