Eric Xiao
Old Toronto, Ontario, Canada
Summary
🤩
Rockstar🎓
Top SchoolEric Xiao is a seasoned data and distributed-systems engineer with 11 years of experience building cost-efficient, production-grade streaming platforms and data products. He has driven multimillion-dollar savings and major latency improvements at companies like Shopify, Walmart Global Tech, and Decodable (acquired by Redis) by optimizing Flink, Spark, and cloud resource usage and introducing autoscaling and scale-to-zero behaviors. Equally comfortable in customer-facing roles, he translates business requirements into high-throughput streaming pipelines and helped ship Decodable’s first streaming+AI solution in weeks. He’s repeatedly led cross-functional projects that tightened data ownership, compliance, and observability while mentoring teams and growing new offices. Known for pragmatic engineering—rewriting core platform components, contributing Flink patches, and turning slow queries into sub-minute analytics—he blends deep systems expertise with product-minded execution. Based in Toronto, he’s quietly effective at turning complex data challenges into measurable operational and business wins.
11 years of coding experience
7 years of employment as a software developer
Bachelor of Engineering (B.E.), Computer Engineering, Bachelor of Engineering (B.E.), Computer Engineering at McMaster University
Github Skills (113)
python10
databases10
pyspark10
hadoop10
sink10
bigtable10
rest-api10
trino10
sql-query10
modular10
big-data10
data-analytics10
formatter10
snowplow10
api10
Programming languages (7)
Github contributions (5)
ericxiao251/DataScience
Oct 2016 - Nov 2018
Contributions:2 PRs, 55 pushes, 2 branches in 2 years
pythonsciencedata-sciencemachine-learningdata-science-learning
ericxiao251/spark-syntax
Aug 2017 - Mar 2019
This is a repo documenting the best practices in PySpark.
Contributions:78 commits, 22 PRs, 131 pushes in 1 year 7 months
pysparkpythonspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.