Liu Cao
Software Engineer at DoorDash
Sunnyvale, California, United States
Summary
🤩
Rockstar🎓
Top SchoolLiu Cao is a software engineer with 11 years of experience specializing in distributed data systems, currently building DoorDash's data platform from Sunnyvale. He is a Spark, Kafka, and Protobuf practitioner who has driven scalable streaming and batch pipelines—combining Spark/Databricks expertise with real-time stacks using Kafka, Flink, Scylla, and ClickHouse. At Akuna Capital he served as the Spark SME, optimizing structured streaming and designing derived data pipelines for analytics and backtesting. He also contributes to high-performance open-source data projects like Apache CarbonData, working on partitioning, schema management, and core performance refinements. Trained in computer science and physics at the University of Chicago, he brings a quantitative mindset to system design and performance optimization.
11 years of coding experience
5 years of employment as a software developer
Nanjing Foreign Language SchoolBachelor's degree Computer Science & Physics, Bachelor's degree Computer Science & Physics at University of Chicago
English, Chinese
Github Skills (9)
javas10
java10
scala10
data-format9
data-formats9
big-data9
hadoop8
data-engineering8
spark7
Programming languages (3)
Github contributions (5)
apache/carbondata
Mar 2017 - Sep 2017
High performance data store solution
Role in this project:
Back-end Developer
Back-end DeveloperContributions:17 commits, 37 PRs, 77 comments in 6 months
Contributions summary:Liu primarily focused on enhancing the CarbonData data store solution, as evidenced by their code contributions. They added logging and refined existing functionalities, like avoiding multiple instances of dictionary generators, and refactored variable names. Additionally, the user worked on parsing partition table DDL and modifying partition information, indicating their involvement in table schema management and optimization. This work includes modifying partition info and creating partition statistics, demonstrating a focus on core functionalities and potential performance improvements.
carbondatadata-formatdata-storeapachebig-data
lionelcao/carbondata
Mar 2017 - Sep 2017
Contributions:120 pushes, 25 branches in 6 months
carbondatajavaapache
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.