Dan Coates
Sr. Software Engineer at SpaceX
Herndon, Virginia, United States
Summary
👤
Senior🎓
Top SchoolDan Coates is a senior software engineer with 10+ years building large-scale data platforms and pipelines, currently architecting Delta Lake and Spark-based telemetry ingestion at SpaceX. He previously led and scaled Capital One’s enterprise streaming platform—designing infrastructure to store 100 billion records per day, shipping SDKs, and enabling zero-downtime Spark deployments. Comfortable toggling between hands-on engineering, product strategy, and mentorship, he has a track record of turning regulatory and business constraints into reliable, auditable systems. His open-source contributions include improving data type compatibility and S3 handling in the blaze/odo project, reflecting attention to correctness in data conversion at scale. Based in Herndon, VA, he pairs deep Python/Spark expertise with pragmatic infra-as-code and platform thinking. Colleagues know him for elegant, data-driven solutions and a drive to elevate others.
10 years of coding experience
20 years of employment as a software developer
Bachelor’s Degree, Computer Science, Bachelor’s Degree, Computer Science at University of MinnesotaWauwatosa East High School
English, French
Github Skills (9)
type-conversion10
convertion10
conversions10
data-conversion10
pytest10
python10
numpy10
data-engineering9
aws-s39
Programming languages (5)
Github contributions (5)
blaze/odo
Jun 2015 - Aug 2016
Data Migration for the Blaze Project
Role in this project:
Backend Developer
Backend DeveloperContributions:11 commits, 8 PRs, 21 comments in 1 year 1 month
Contributions summary:Dan primarily contributed to enhancing the data migration functionalities of the `odo` project. They focused on improving the compatibility of data types, including the addition of support for `timedelta` and `Decimal`. Their work involved modifying the `numpy_dtype.py` file and adding tests in `test_numpy_dtype.py` to ensure correct data type conversions and integrations. Additionally, they addressed an S3-related issue by passing arguments to S3 `append_text_to_s3` functions.
data-migrationmigrationblaze
dan-coates/odo
Jun 2015 - Aug 2016
Contributions:27 pushes, 5 branches, 1 comment in 1 year 1 month
data-migrationmigrationblaze
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.