Huadong Liu
Software Engineer at Google
San Francisco Bay Area United States
Summary
🤩
Rockstar🎓
Top SchoolHuadong Liu is a seasoned software engineer with a decade of experience building high-performance data and compute infrastructure across top tech companies in the Bay Area. He has driven Spark, Iceberg, and lakehouse initiatives at Snap and Dataproc/Spark performance work at Google, and previously unified Jupyter analytics, ETL, GPU inference and model training into Yelp’s Spark platform. His background spans low-level RDMA and clustering work at NetApp to privacy-first cloud storage for Siri at Apple, giving him rare expertise across networking, storage and large-scale ML pipelines. An active contributor to Yelp’s open-source PaaSTA platform, he focuses on automating build, deployment and operational tooling for distributed services. He holds a Ph.D. in data-intensive network computation and blends research rigor with a practical record of shipping production systems that power revenue-critical ML workflows.
10 years of coding experience
16 years of employment as a software developer
Bachelor's degree, Computer Engineering, Bachelor's degree, Computer Engineering at Nanjing University of Posts and TelecommunicationsPh.D. Computer Science, Data-intensive Network Computation, Ph.D. Computer Science, Data-intensive Network Computation at University of Tennessee, Knoxville
Github Skills (11)
kubernetes10
automation10
docker10
automations10
devops10
paas10
dockers10
kubernetes-pods10
python8
testing7
spark7
Programming languages (4)
Github contributions (5)
Yelp/paasta
Apr 2016 - Dec 2019
An open, distributed platform as a service
Role in this project:
DevOps Engineer
DevOps EngineerContributions:176 commits, 146 PRs, 229 pushes in 3 years 8 months
Contributions summary:Huadong's contributions primarily focused on the PaaSTA platform's deployment and operational aspects within the yelp/paasta repository. The user made several changes to the `paasta_serviceinit.py` tool, the testing infrastructure, and the setup of marathon jobs and overall codebase. They also added the spark-run command which includes creating and handling Docker images and related configuration. The changes suggest a focus on automating the build, deployment and operational processes for services on the PaaSTA platform.
mesosdockerplatform-as-a-servicedistributed-systemsmicroservices
huadongliu/service_configuration_lib
Jun 2016 - Sep 2016
Contributions:1 push, 2 branches in 3 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.