John Cheng
Trading Data Engineer
Hong Kong, China
Summary
👤
Senior🎓
Top SchoolJohn Cheng is a Trading Data Engineer based in Hong Kong with nearly a decade of hands-on experience building cloud-native data platforms, real-time pipelines, and operational dashboards for trading and media businesses. He specializes in orchestrating production data workflows with Airflow on Kubernetes, automating ETL/ELT, and implementing CI/CD to reliably deliver analytics and KPI reporting. His background spans AWS-managed data lakes, Redshift warehousing, streaming with Kinesis and Presto, and integrating on-prem systems—skills honed across Crypto.com, HK01, and enterprise clients. An active contributor to Apache Airflow, he has implemented KubernetesExecutor improvements and added support for MongoDB and DNS seedlist connections, reflecting a propensity for practical open-source fixes that ease large-scale deployments. With a physics degree from CUHK, he brings a data-driven, empirical mindset to engineering tradeoffs and performance tuning. Colleagues know him for turning complex operational requirements into automated, observable systems that reduce manual firefighting.
9 years of coding experience
4 years of employment as a software developer
The Chinese University of Hong Kong (CUHK)
English, Chinese
Github Skills (15)
apache-airflow10
data-pipelines10
data-pipeline10
mongodb10
python10
mongodb-database10
data-engineering10
kubernetes-pods9
etl9
kubernetes9
automations8
automation8
devops8
dockers7
docker7
Programming languages (4)
Github contributions (5)
apache/airflow
Mar 2018 - Aug 2023
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Role in this project:
Back-end Developer
Back-end DeveloperContributions:2 reviews, 7 PRs, 20 comments in 5 years 5 months
Contributions summary:John contributed to the Apache Airflow project by implementing several features and fixing bugs. They modified the Kubernetes executor configuration by adding volume mounts and volumes to the KubernetesExecutorConfig. They also added support for MongoDB connection and DNS seedlist connection format, along with fixing plugins import and other related issues. Furthermore, they refactored the codebase to inherit and remove unnecessary arguments, and they modified logging and sftp operators.
monitorpythonschedulerapacheprogrammatically
ckljohn/airflow-on-EKS
Sep 2018 - Sep 2021
Contributions:7 commits, 1 PR, 3 pushes in 2 years 11 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.