Xiaoxue Duan
Senior Data Engineer
Redwood City, California, United States
Summary
👤
Senior🎓
Top SchoolXiaoxue Duan is a Senior Data Engineer in Redwood City with nine years of experience building scalable data warehouses, ETL pipelines, and real-time streaming systems across ad tech and enterprise domains. She combines strong statistical training (MS in Statistics) and a PhD background with hands-on expertise in Python, Java, SQL, Airflow, Kafka Streams, Redshift, AWS/GCP and Hadoop to cut ETL runtime, automate reporting, and improve data quality. At PlatformQ she redesigned pipelines to reduce runtime by over 60% and launched a 28-dashboard self-service reporting platform; at CBRE she automated a metric that reduced analysis time from days to minutes and generated $650k in annual savings. Now at Walmart Global Tech she focuses on real-time Java/Spring Boot and Kafka Streams solutions for ad tech while still contributing Python batch processing work. Colleagues rely on her for pragmatic pipeline improvements that save operational hours and for translating complex analytics into usable business tools.
9 years of coding experience
11 years of employment as a software developer
Master's degree Tourism management, Master's degree Tourism management at East China Normal UniversityBachelor's degree Tourism, Bachelor's degree Tourism at Shanghai University of International Business and EconomicsMaster's degree Statistics, Master's degree Statistics at University of Illinois Urbana-ChampaignDoctor of Philosophy - PhD Tourism and Travel Services Management, Doctor of Philosophy - PhD Tourism and Travel Services Management at Zhejiang University
English, Chinese
Stackoverflow
1reputation
398reached
0answers
1question
Github Skills (2)
apache-superset6
configurations6
Github contributions (5)
XiaoyueDuan/Zbuffer
Mar 2017 - Jun 2017
Contributions:28 commits, 20 pushes, 2 branches in 2 months
XiaoyueDuan/RayTracing
May 2017 - Jun 2017
Contributions:28 commits, 3 pushes, 7 branches in 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.