Liang-chi Hsieh
Apache Software Foundation Member
Seattle, Washington, United States
Summary
🤩
Rockstar🎓
Top SchoolLiang-chi Hsieh is a senior software engineer with 17 years of experience building and optimizing large-scale data processing and distributed systems, currently a Staff Software Engineer at Databricks and an Apache Software Foundation member. He is a long-standing committer and PMC member across flagship projects like Apache Spark, Arrow, and DataFusion, contributing performance optimizations, query engine features, and Rust-native kernels. His work spans core engine code, cross-language integrations (Rust/Python), and compression/compatibility improvements for Hadoop and Spark on YARN, reflecting deep systems and interoperability expertise. Liang-chi blends research rigor—holding a PhD from National Taiwan University—with production-grade engineering learned at Apple, Uber, and Databricks. He frequently contributes non-obvious but impactful fixes such as code-generation performance tweaks, dictionary-array comparison support, and Parquet filename/path corrections in delta-rs. Based in Seattle, he combines open-source stewardship with hands-on backend development to drive reliable, high-performance data platforms.
17 years of coding experience
12 years of employment as a software developer
Doctor of Philosophy (Ph.D.) Computer Science, Doctor of Philosophy (Ph.D.) Computer Science at National Taiwan University
English, Chinese
Github Skills (49)
algorithm10
algorithms10
apache-spark10
debug10
gzip10
spark10
apache-storm10
delta-lake10
back-end-development10
data-engineering10
testing10
hadoop10
arrow-keys10
data-structure10
java10
Programming languages (18)
Github contributions (5)
apache/spark
Nov 2014 - Mar 2022
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer & Data Engineer
Back-end Developer & Data EngineerContributions:4058 reviews, 136 commits, 1414 PRs in 7 years 4 months
Contributions summary:Liang-chi contributed to Apache Spark, a unified analytics engine for large-scale data processing. They primarily focused on improving the functionality of and contributing to the underlying source code. The commits include bug fixes, code optimizations, and improvements to the core functionalities within the system. Moreover, the commits show a focus on improving the efficiency and performance of Spark by contributing to the code generation process.
analyticspythondata-processingsqlapache
apache/arrow-rs
Dec 2021 - Jan 2023
Official Rust implementation of Apache Arrow
Role in this project:Back-end Developer
Back-end DeveloperContributions:1591 reviews, 217 commits, 449 PRs in 1 year 1 month
Contributions summary:Liang-chi primarily contributed to implementing the official Rust implementation of Apache Arrow. Their work included adding and improving various arithmetic kernels for primitive arrays and dictionary arrays. Their contributions specifically enhanced kernels for features such as addition, subtraction, multiplication, and division operations. Furthermore, they enhanced the capabilities of comparison kernels by introducing dictionary array support.
rustolapapachearrowapache-arrow
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.