Wangda Tan
Principal Architect at The Apache Software Foundation
Palo Alto, California, United States
Summary
🤩
Rockstar🎓
Top SchoolWangda Tan is a Principal Architect and seasoned distributed-systems engineer with 11 years of experience building large-scale data platforms and ML infrastructure, now driving Knowledge Graph and NL2SQL strategy at Salesforce. He co-founded Waii, scaled it into enterprise and Fortune 500 customers by solving the “last mile” of GenAI with a text-to-SQL engine and knowledge graph, leading to acquisition by Salesforce. A long-time Apache contributor and PMC member (Hadoop, YuniKorn, Submarine), he has hands-on wins in scheduler design, preemption, and container resizing—contributions that improved resource allocation in the widely used Apache Hadoop and YuniKorn projects. Previously he led Snowflake’s workload optimization and observability efforts and ran Cloudera’s managed Data Engineering services, combining product-driven leadership with deep C++/Java and Python engineering. Based in Palo Alto, he blends open-source stewardship with startup grit and a conviction that big-data analytics will reshape industries. An often-overlooked strength: he has driven cross-cloud, multi-region compute platforms and grown many engineers into open-source committers and PMC members.
11 years of coding experience
14 years of employment as a software developer
Bachelor Automatizatopm, Bachelor Automatizatopm at Huazhong University of Science and TechnologyChongqing No.1 Middle School
Chinese, English
Stackoverflow
11reputation
264reached
2answers
1question
Github Skills (21)
kubernetes10
cap10
testing10
resource-management10
java10
scheduler10
javas10
go10
sched10
kubernetes-pods10
yarnpkg10
yarn310
yarn-berry10
yarn210
software-design9
Programming languages (9)
Github contributions (5)
apache/hadoop
Jan 2015 - Jan 2021
Apache Hadoop
Role in this project:
Backend Developer
Backend DeveloperContributions:670 commits in 6 years 1 month
Contributions summary:Wangda contributed to the Apache Hadoop project by working on preemption policies for the CapacityScheduler. They modified code within the ProportionalCapacityPreemptionPolicy and other related test classes, indicating a focus on performance and resource allocation improvements. The changes included refactoring the exception handling code for TimelineClientImpl and enhancing logging, demonstrating an understanding of system design and troubleshooting. The user also implemented the support for container level resource resizing in AMRMClient.
apachebig-datasparkhadoopjava
apache/yunikorn-core
Mar 2019 - Jun 2020
Apache YuniKorn Core
Role in this project:Back-end Developer
Back-end DeveloperContributions:13 commits, 12 PRs, 3 pushes in 1 year 3 months
Contributions summary:Wangda contributed to the core implementation of the Apache YuniKorn scheduler. Their initial commit focused on the core implementation of the scheduler and included changes to the cache package, specifically the `cluster_info.go` file. Subsequent commits introduced features for preemption, including DRF-based preemption policies, partition configuration, and tests for preemption. Further commits improved tests, demonstrating a focus on system robustness and stability.
universal-resource-scheduleryunikornapacheapache-yarnkubernetes
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.