Chen Luo is a Principal Software Engineer based in California with a decade of experience building high-performance storage and database systems, currently leading the Unistore Storage team at Snowflake. He holds a PhD from UC Irvine focused on database storage engines and has deep operational and analytical storage expertise, having built transactional engines and columnar caches for hybrid workloads. Chen’s work spans research and production—contributions to Apache Spark SQL to fix deadlocks and improve function pushdown illustrate his knack for subtle, correctness-critical fixes in widely used open-source systems. Previously a committer on AsterixDB and an intern at Microsoft and IBM Research, he blends rigorous academic training with pragmatic system design and team leadership. An interesting detail: his background includes low-level storage work on open-channel SSDs and BW-tree/LLAMA, informing his current innovations in key-value backed hybrid table storage.
10 years of coding experience
6 years of employment as a software developer
Bachelor of Engineering, Software Engineering, Bachelor of Engineering, Software Engineering at Tongji University
Master of Science (MS), Software Engineering, Master of Science (MS), Software Engineering at Tsinghua University
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Contributions:37 reviews, 1 commit, 13 PRs in 1 day
Contributions summary:Chen primarily contributed to improving the Apache Spark SQL module, focusing on resolving potential deadlock issues within the `CatalogManager` and addressing errors related to attribute resolution in view joins. Their work included modifying the `CatalogManager.currentNamespace` function to reduce the scope of synchronization and implementing fixes for issues arising from duplicate views. They also focused on enhancing the system by adding support for push down string and datetime functions in DS V2.
customized spark for KAP use, checkout kyspark branch
Contributions:2 PRs, 166 pushes, 20 branches in 2 years
customizedspark-mlcheckoutkapspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Chen Luo - Principal Software Engineer at Snowflake