Miao Wang
Director Of Engineering at The Apache Software Foundation
San Jose, California, United States
Summary
👤
Senior🎓
Top SchoolMiao Wang is a Director of Engineering at Adobe with a decade of experience building large-scale data platforms and leading global engineering teams from San Jose. She spearheads Adobe Lakehouse and previously led platform engineering for Adobe Experience Platform 2.0, driving scalable ingestion, governance, and real-time customer data solutions using Spark, Kafka, Iceberg and Kubernetes. A hands-on engineer at heart, she has deep Apache Spark expertise—contributing PySpark ML enhancements and implementing PowerIterationClustering as a transformer in spark.ml—alongside a history of open-source commits to Apache Toree. Her background spans high-performance networking and distributed systems at Alibaba, IBM, and A10, where she engineered solutions for terabyte-scale processing, RDMA monitoring, and traffic engineering. Wharton-trained in business and holding advanced computer science degrees, she combines technical depth with product and team-building instincts, having grown and promoted multiple engineers under her leadership. An engineering leader comfortable moving between production code, open-source projects, and executive strategy, she brings rare cross-domain fluency in data infrastructure and applied ML.
10 years of coding experience
22 years of employment as a software developer
Ph.D Computer Science, Ph.D Computer Science at University of Nebraska-LincolnBachelor Electrical Engineering, Bachelor Electrical Engineering at Xi'an Jiaotong UniversityMaster of Business Administration - MBA Business Administration and Management General, Master of Business Administration - MBA Business Administration and Management General at The Wharton School
Chinese, English
Github Skills (5)
machine-learning10
pyspark10
python10
clustering10
data-processing10
Programming languages (4)
Github contributions (5)
apache/spark
Jan 2017 - Jan 2017
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Back-end DeveloperContributions:1 commit, 93 PRs, 598 comments in 1 day
Contributions summary:Miao primarily contributed to the Python implementation of PySpark ML features, specifically focusing on enhancing the Python API for machine learning functionalities within the Spark ecosystem. Their work involved adding new parameters, modifying existing methods, and adding new tests to support these changes. The user implemented and documented the functionality of a PowerIterationClustering as a transformer in spark.ml. These changes show the user's expertise in Spark ML and data processing.
analyticspythondata-processingsqlapache
wangmiao1981/spark
Sep 2015 - Jun 2021
Mirror of Apache Spark
Contributions:5 PRs, 408 pushes, 58 branches in 5 years 10 months
spark-mlapachebig-datasparkscala
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.