Will Farrell
Principal Data Engineer
St. Louis, Missouri, United States
Summary
👤
Senior🎓
Top SchoolWill Farrell is a Principal Data Engineer with nine years of experience building scalable data platforms and pipelines using Databricks, Spark, Kafka, Snowflake and cloud-native tooling. He leads data engineering practices, architects high-throughput streaming systems, and has a track record of modernizing ingestion and governance for product and data science teams. Will’s background spans hands-on Spark streaming at 5k events/sec, cost and performance optimization, and full-stack engineering in Node, Python and Go—skills he leverages to balance platform reliability with developer productivity. Based in St. Louis, he pairs technical leadership with a teaching and operations pedigree from education and athletics roles, bringing strong coaching, process design, and data-driven decision-making to engineering teams.
9 years of coding experience
9 years of employment as a software developer
Full-stack Software Development Computer Programming, Full-stack Software Development Computer Programming at Dev BootcampMaster's degree Educational Leadership and Administration General, Master's degree Educational Leadership and Administration General at Louisiana State UniversityB.A. in Political Science Data and Analysis within the context of Political Science, B.A. in Political Science Data and Analysis within the context of Political Science at Creighton University
English
Stackoverflow
1,390reputation
1.9mreached
18answers
0questions
amazon-s3
top-5%
Github Skills (44)
amazon-s39
nodejs9
customisation7
maven6
jupyter-notebook6
react6
presignedurl6
typescript6
ipython6
amazon-web-services6
python6
scala6
apache-spark6
npm6
matplotlib6
Programming languages (8)
Github contributions (5)
F3Nation-Community/PAXminer
Jan 2024 - Mar 2025
PAXminer is a set of tools to automatically pull, parse, capture, and store workout information from F3 Beatdowns. Check it out! Any and all contributions are welcome.
Contributions:1 review, 43 PRs, 72 pushes in 1 year 2 months
farrellw/school-budget
Nov 2019 - Apr 2020
Visualizing the SLPS budget
Contributions:47 PRs, 125 pushes, 47 branches in 4 months
budgetvisualizingvisualization
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.