Zeyu Zhang
Amsterdam, North Holland, Netherlands
Summary
🤩
Rockstar🎓
Top SchoolZeyu Zhang is a data engineering researcher and practitioner with 11 years of experience focused on data management techniques for pervasive machine learning. Based in Amsterdam and affiliated with BIFOLD & TU Berlin, he bridges academic research and industry practice, with prior stints at UvA, NYU, Amazon, and Twitter. He contributes to high-impact open-source tooling—most notably extending awslabs/deequ with incremental metric computation, anomaly detection examples, and performance optimizations for large-scale data quality checks. Zeyu blends back-end engineering skills with a research mindset, designing reproducible, production-ready solutions for data quality and profiling. His work often emphasizes incremental and scalable approaches that make ML data pipelines more auditable and efficient. Continuously learning through roles in academia and industry, he leverages practical deployments to inform his research directions.
11 years of coding experience
University of Amsterdam
Github Skills (7)
apache-spark10
data-quality10
scala10
data-engineering9
unit-test9
unit-testing9
anomaly-detection8
Programming languages (8)
Github contributions (5)
awslabs/deequ
Sep 2018 - Mar 2020
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Role in this project:
Back-end Developer & Data Engineer
Back-end Developer & Data EngineerContributions:7 releases, 2 reviews, 79 commits in 1 year 6 months
Contributions summary:Zeyu primarily contributed to the `awslabs/deequ` repository by implementing and extending the functionality of the library related to data quality, particularly focusing on incremental metric computation and data profiling. They added examples for incremental metrics, storing and retrieving metrics from a repository. Furthermore, the user added an anomaly detection example and constraint suggestions and improved existing features, like histograms for boolean columns and KLL sketch optimizations.
data-qualityapacheunitsparkunit-tests
schelterlabs/arguseyes
Jul 2021 - Dec 2022
Contributions:78 commits, 47 pushes, 7 branches in 1 year 5 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.