David Hill

Petabyte Scale Data Engineer

Sioux Falls, South Dakota, United States
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts

Summary

👤
Senior
🎓
Top School
David Hill is a petabyte-scale data engineer with over 25 years of experience designing and operating distributed systems for government and defense customers, including USGS, NASA, DOD, and major aerospace contractors. He has owned the full satellite data lifecycle since 2006—from flight software and telemetry/command ground systems to large-scale science product generation, archival, and public distribution. His recent work leading ground system data engineering at KBR and USGS-EROS combines cloud-native stacks (AWS, Kubernetes, Spark/Dask) with HPC and observational science tooling like Pangeo to deliver mission-critical, auditable pipelines. Now self-employed, he focuses on DAG integrity problems—verifying transformation presence and input provenance to ensure pipelines are untampered and reproducible. A former airborne maintenance technician with deep field experience in ISR platforms, he brings operational rigor and systems-thinking to software reliability at scale. Based in Sioux Falls, he blends low-level systems grounding with high-level data product engineering to solve complex, mission-driven data challenges.
code13 years of coding experience
job23 years of employment as a software developer
bookB.S Information Systems Management, B.S Information Systems Management at University of Maryland Global Campus
bookA.A.S Avionic Technologies, A.A.S Avionic Technologies at Community College of the Air Force
bookMaster of Science (M.S.) Computer Science - Software Engineering, Master of Science (M.S.) Computer Science - Software Engineering at Colorado Technical University
github-logo-circle

Github Skills (90)

fulfillment10
api9
change-detection9
api-client9
pyspark9
classification9
partitions8
cli8
httpie8
rest8
rest-api8
twine8
spectral8
emr8
debugging8

Programming languages (8)

DockerfileShellCJavaScriptJupyter NotebookPythonFortranClojure

Github contributions (5)

github-logo-circle
USGS-EROS/espa-junk-drawer

Jul 2015 - Apr 2019

A shared repository for code that doesn't have an official home.
Contributions:1 PR, 1 push, 2 branches in 3 years 9 months
USGS-EROS/lcmap-spark

Mar 2017 - Oct 2018

LCMAP SEE base image.
Contributions:1 release, 6 PRs, 256 pushes in 1 year 7 months
base-image
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
David Hill - Petabyte Scale Data Engineer