Yiheng Wang
Software Architect at Intel Corporation
Minhang District, Shanghai, China
Summary
🤩
Rockstar🎓
Top SchoolYiheng Wang is a Software Architect with 11 years of experience building and scaling distributed machine learning systems, currently leading BigDL development at Intel to bring deep learning to Apache Spark at production scale. He combines back-end engineering, algorithm acceleration, and end-to-end big data solution design, with hands-on experience in distributed ML, test automation, and CI from prior roles at Morgan Stanley and Microsoft. An active open-source contributor, he improved functionality and test coverage for Apache Livy—helping Spark interop via Thrift and Python test environments—and focuses on reliability for metadata and session management features. Comfortable bridging research-grade algorithms and enterprise deployment, he also has a strong foundation from a master's in Computer Software and Theory from Shanghai Jiao Tong University.
11 years of coding experience
3 years of employment as a software developer
Master's degree, Computer Software and Theory, Master's degree, Computer Software and Theory at Shanghai Jiao Tong University
English
Github Skills (12)
livy10
unit-testing10
javas10
big-data10
apache-spark10
spark10
java10
integration-testing10
testing10
thrift9
scala8
python8
Programming languages (7)
Github contributions (5)
apache/incubator-livy
Jul 2019 - Nov 2019
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
Role in this project:
Back-end Developer & Test Automation Engineer
Back-end Developer & Test Automation EngineerContributions:10 commits, 47 PRs, 261 comments in 4 months
Contributions summary:Yiheng primarily contributed to improving the Apache Livy project's functionality and reliability. They addressed issues by modifying existing code, particularly within the Thrift server and Python API test environments. The user added comprehensive unit and integration tests, focusing on metadata operations, log retrieval, and session management. Their work included supporting new features like GetSchemas, GetFunctions, GetTables, and GetColumns.
apache-livybigdataapacheanywherespark
intel-analytics/BigDL-Tutorials
May 2017 - Mar 2018
Contributions:13 commits, 6 PRs, 4 pushes in 10 months
sciencedata-scienceto-doapachebig-data
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.