Yadong Qi
Software Engineer at Huawei Technologies
Hangzhou City, Zhejiang, China
Summary
👤
Senior🎓
Top SchoolYadong Qi is a seasoned software engineer with 12 years of experience, currently focused on developing and optimizing large-scale data frameworks at Huawei in Hangzhou. He combines deep backend engineering skills with product insight from earlier roles, and has substantial ToB service experience including NA customer engagements. An active open-source contributor, he has improved Apache Spark’s core, SQL, and streaming components and extended CarbonData’s storage and indexing features, demonstrating attention to correctness and performance in widely used big-data projects. Yadong is adept at bridging low-level implementation details and higher-level product planning, often catching subtle bugs (e.g., sampling calculations and parser syntax) that improve system robustness.
11 years of coding experience
学士, 计算机科学与技术, 学士, 计算机科学与技术 at Hangzhou Dianzi University
Chinese, English
Github Skills (13)
data-formats10
javas10
data-storage10
hive10
big-data10
spark10
sql10
data-format10
java10
scala10
apache9
streaming9
jdbc4
Programming languages (2)
Github contributions (5)
apache/spark
Jan 2015 - May 2017
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Back-end DeveloperContributions:37 PRs, 131 comments in 2 years 4 months
Contributions summary:Yadong contributed to the Apache Spark project by fixing bugs and improving code quality across several modules, including core, SQL, and streaming components. Their work involved addressing issues such as unused variables, redundant logic, and incorrect comments. The user also implemented features like supporting plus signs and 'show roles' in HiveContext and fixing sampling percentage calculations. Their contributions demonstrate a focus on refining and extending the functionality of Spark's SQL and streaming features.
analyticspythondata-processingsqlapache
apache/carbondata
Mar 2017 - Jun 2017
High performance data store solution
Role in this project:Back-end Developer
Back-end DeveloperContributions:13 commits, 14 PRs, 49 comments in 3 months
Contributions summary:Yadong contributed to the Apache CarbonData project by implementing and testing features related to data storage formats (Parquet/ORC). Their work included modifications to the Spark SQL parser to support new syntax for specifying file formats. Additionally, they focused on ensuring the correct file names were stored within CarbonData indexes and made several improvements related to index creation and file writing, particularly concerning index file versioning and ensuring the correct file names within those indexes.
carbondatadata-formatdata-storeapachebig-data
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.