Dillon Stadther
Principal Software Engineer at InMarket
Apex, North Carolina, United States
Summary
🤩
Rockstar🎓
Top SchoolDillon Stadther is a Principal Software Engineer with 10 years of experience designing and operating data platforms and ETL pipelines that power business insights and product features. He has driven migrations from Azure-based ETL to Kubernetes-native Airflow at scale, managed tens of thousands of nightly job runs, and helped move monolithic fraud detection systems to resilient serverless microservices. A hands-on data engineer and backend developer, Dillon contributed to the widely used Spotify/luigi project by adding Redshift support and role-based credential enhancements. He pairs deep technical craft—Python, PySpark, Airflow, Redshift, Kubernetes—with mentorship and cross-team communication to turn complex requirements into reliable, scalable systems. Based in Apex, NC, he draws on a blend of CS, mathematics, and liberal arts to keep a broad perspective while focusing on making the world’s information more available and useful.
10 years of coding experience
8 years of employment as a software developer
Bachelor of Science (BS) Computer Science, Bachelor of Science (BS) Computer Science at Gardner-Webb University
English, Spanish
Stackoverflow
405reputation
27kreached
7answers
7questions
Github Skills (17)
aws-redshift10
data-pipelines10
python10
amazon-redshift10
sql10
orchestration-framework10
data-pipeline10
hadoop9
authentication8
scheduling8
user-authentication8
version-control6
feature-branch6
gitflow6
luigi6
Programming languages (8)
Github contributions (5)
spotify/luigi
Oct 2015 - Jun 2022
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Role in this project:
Back-end Developer & Data Engineer
Back-end Developer & Data EngineerContributions:3 releases, 190 reviews, 67 commits in 6 years 8 months
Contributions summary:Dillon primarily contributed to the `luigi/contrib/redshift.py` module, adding support for Redshift data loading and management. Their work included implementing features for copying data to temporary tables, pruning tables based on date, and performing pre- and post-copy SQL operations. They also enhanced the existing functionality by incorporating role-based credential support. Furthermore, the user added improvements in authentication for gmail.
pythonbatch-jobsdependency-resolutionorchestration-frameworkworkflow-management
dlstadther/luigi-monitor
Mar 2016 - Aug 2018
Send summary messages of your Luigi jobs to Slack
Contributions:1 PR, 19 pushes, 9 branches in 2 years 6 months
slackluigijobs
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.