Nathan Liu is a Principal Scientist at Amazon Ads with six years of focused industry experience building production-grade machine learning systems for search, recommendation, personalization, and advertising. He combines a PhD-level research background from HKUST with senior roles across YouTube, Yahoo, LinkedIn and startups, delivering cloud-native ML solutions and campaign optimization products. Nathan has deep expertise in recommender systems, NLP, time series analysis and Python, and has contributed to the well-known Apache Gobblin project by improving Kafka integration and robust container resource handling—showing an attention to scalable data integration beyond model development. Based in Saratoga, California, he blends research rigor with pragmatic engineering, often stepping into backend platform work to ensure models operate reliably at scale.
6 years of coding experience
10 years of employment as a software developer
The Chinese University of Hong Kong (CUHK)
Beijing No.4 High School
Hong Kong University of Science and Technology (HKUST)
A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
Role in this project:
Back-end Developer
Contributions:81 reviews, 12 commits, 26 PRs in 1 year 10 months
Contributions summary:Nathan primarily focused on enhancing Apache Gobblin's Kafka integration. They added support for Kafka 1.x, developed features for metadata change events (GMCE), and improved the handling of container resources within the Yarn service. Furthermore, the user addressed JVM hangs during Kafka flush operations and optimized the container allocation process, demonstrating a strong understanding of the project's core data integration functionalities. They also contributed to test cases, ensuring the stability of these enhancements.
Gobblin is a distributed big data integration framework (ingestion, replication, compliance, retention) for batch and streaming systems. Gobblin features integrations with Apache Hadoop, Apache Kafka, Salesforce, S3, MySQL, Google etc.
Contributions:97 pushes, 20 branches in 3 years 8 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.