Huaxin Gao
Software Engineer at Snowflake
San Jose, California, United States
Summary
🤩
RockstarHuaxin Gao is a software engineer with 10 years of experience building distributed data platforms and query engines, currently at Snowflake after a multi-year tenure at Apple. He is an active open-source committer and PMC member for Apache Spark and a committer on Apache Iceberg and DataFusion, contributing performance improvements such as filter and aggregate pushdowns and metadata/schema fixes. His background spans low-level database drivers and patents from earlier IBM work to modern big-data systems (Spark ML/SQL), giving him a rare mix of systems, data engineering, and platform expertise. Based in San Jose, he pairs production-grade engineering with meticulous documentation and website maintenance for flagship projects like the Apache Spark site—an attention to detail that keeps both code and community resources reliable.
10 years of coding experience
24 years of employment as a software developer
Github Skills (15)
html10
parquet10
javas10
apache-spark10
maintenance10
spark10
java10
documentation10
apache-iceberg10
filter9
data-engineering9
filtering9
markdown-it8
markdown8
apache8
Programming languages (6)
Github contributions (5)
apache/iceberg
Jan 2022 - Nov 2022
Apache Iceberg
Role in this project:
Back-end Developer / Data Engineer
Back-end Developer / Data EngineerContributions:502 reviews, 14 commits, 67 PRs in 10 months
Contributions summary:Huaxin primarily contributed to fixing issues within the core of the Apache Iceberg project. Their commits focused on addressing problems in the metadata table, specifically related to partition column naming and schema conflicts. They also made contributions to improve the pushdown of filters in Spark 3.2 and push down aggregate functions, which enhances query performance. The user also worked on improving data file format support, including bloom filters, and added configuration options for fine-grained control over bloom filter behavior.
apache-icebergapachebig-datadatastreamjava
apache/spark-website
Jul 2020 - Jan 2022
Apache Spark Website
Role in this project:Technical Writer
Technical WriterContributions:5 reviews, 5 commits, 9 PRs in 1 year 7 months
Contributions summary:Huaxin primarily contributes to the Apache Spark website by updating release notes, documentation, and website content. Their work involves adding release information for Spark 3.2.1, correcting version numbers, and fixing display issues within the HTML content. The user also updates contributor information. These changes highlight a focus on maintaining the accuracy and presentability of the Spark documentation and website resources.
pythonsqlapachebig-dataspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.