Hao Lin
Software Engineer at Meta
San Francisco Bay Area United States
Summary
👤
Senior🎓
Top SchoolHao Lin is a software engineer with 12 years of experience designing large-scale data infrastructure, distributed computing, and cloud-native systems, currently leading AI-based recommendation and resource management efforts at Meta. He has driven efficient scheduling and distributed resource management for large PyTorch models and Apache Spark workloads at Facebook scale, and played a tech lead role in launching Messenger ads to significant revenue. His background includes a PhD in Electrical & Computer Engineering from Purdue and early work on dynamic MapReduce rebalancing at Google Cloud Dataflow, reflecting strong research-to-production chops. An active contributor to open-source tooling, he extended the R frontend for Spark (SparkR) with practical data operations and tests, showing a knack for bridging analytics ecosystems and production systems.
12 years of coding experience
Doctor of Philosophy - PhD, Electrical & Computer Engineering, Doctor of Philosophy - PhD, Electrical & Computer Engineering at Purdue UniversityB.S., Automatic control, B.S., Automatic control at Tsinghua University
Github Skills (4)
spark10
r10
data-analysis9
unit-testing8
Programming languages (4)
Github contributions (5)
amplab-extras/SparkR-pkg
Oct 2014 - Apr 2015
R frontend for Spark
Role in this project:
Back-end Developer
Back-end DeveloperContributions:66 commits, 13 PRs, 40 comments in 5 months
Contributions summary:Hao primarily contributed to the R frontend for Spark, adding new functions to extend the R interface's capabilities. These additions include functions for distinct, mapValues, filter, and union operations, along with supporting tests. The user also fixed a typo and improved code style, along with addressing minor issues.
apache-sparkfrontendrspark
hlin09/SparkR-pkg
Feb 2015 - Apr 2015
Contributions:44 commits, 41 pushes, 18 branches in 2 months
frontendspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.