David Sharp
Principal Engineer at Marquez
Wellington, Wellington, New Zealand
Summary
🤩
Rockstar🎓
Top SchoolDavid Sharp is a Principal Engineer and data platform specialist with 8 years of experience designing and delivering end-to-end data pipelines, CI/CD, and automated testing across SQL Server, Teradata, Tableau and OpenShift. He blends hands-on Python engineering, Airflow orchestration and metadata lineage (Marquez committer) with team leadership and developer coaching to raise delivery quality and best practices. At ANZ he introduced CI/CD from Bitbucket to Jenkins, built pytest-based testing for database and BI artifacts, and implemented Airflow on OpenShift for robust scheduling. He also develops practical data services—replication, API uploads and cross-database procedure runners—and has applied NLP models to classification and prediction problems. Notably, he contributes upstream to open-source projects (Marquez, Airflow) and has simplified Kubernetes executor startup behavior, showing a knack for improving both developer experience and production reliability.
8 years of coding experience
12 years of employment as a software developer
Bachelor of Science - BS Comouter Science, Bachelor of Science - BS Comouter Science at Coventry University
Github Skills (38)
apache-airflow10
aggregate10
data-governance10
data-pipelines10
python10
data-science10
ecosystem10
data-engineering10
machine-learning10
workflow-engine10
metadata10
data-dictionary10
visualize10
apache10
data-management10
Programming languages (2)
Github contributions (5)
davidsharp7/marquez
Aug 2023 - May 2025
Collect, aggregate, and visualize a data ecosystem's metadata
Contributions:177 pushes, 33 branches in 1 year 9 months
davidsharp7/dummy
Nov 2017 - Dec 2021
Contributions:4 PRs, 7 pushes, 5 branches in 4 years 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.