DataFibers Admin
Summary
👤
SeniorWill Du is a senior data engineer and solution architect with over a decade of experience designing high-throughput distributed data systems for major financial institutions. He specializes in migrating legacy systems to cloud and Spark/Databricks platforms, building real-time feature engineering pipelines to productionize AI/ML models, and codifying enterprise data architecture and metadata pipelines. His background spans TD, Citi, CIBC, HSBC, RBC and Expedia, where he delivered risk, credit, and analytics platforms over enterprise data lakes. A Databricks Certified Data Engineer, open-source committer and coach, Will blends hands-on engineering with architecture and team enablement. Based in Old Toronto, he pairs rigorous academic training (MCS) with a practical track record of turning complex financial data requirements into scalable, auditable systems.
10 years of coding experience
Github Skills (71)
drone-ci10
single-page-application10
rest10
data-service10
1c10
aerospike10
graphql-api9
react-admin9
stream9
hadoop9
material-ui9
streaming9
gitbook9
react9
vertx9
Programming languages (8)
Github contributions (5)
datafibers-community/df_complete_guide
Oct 2016 - Aug 2019
Contributions:144 commits, 113 pushes, 1 branch in 2 years 10 months
datafibers/simple_stream
May 2018 - Oct 2019
course demo
Contributions:19 commits, 40 pushes, 1 branch in 1 year 5 months
reactgocdjavascriptstreamsstream
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.