Dan Harvey
Software Engineer at Hadoop User Group (HUG UK)
England, United Kingdom
Summary
👤
Senior🎓
Top SchoolDan Harvey is a seasoned software engineer with 15 years’ experience building scalable distributed systems and machine learning pipelines, currently working at Meta from London. He combines deep academic grounding (MSc in AI, BSc in Physics/Maths/CS) with hands-on architecture work—having led data mining and platform design at Mendeley and served as Data Architect at State. Dan has a long history of Hadoop and large-scale data engineering (organising HUG UK since 2010) and a track record of moving teams from monoliths to service-oriented, cloud-ready platforms. He bridges research and production: implementing search, de-duplication and analytics systems while operationalising ML and text analysis workflows. Notably, his background includes founding a tech startup and winning early funding, reflecting an entrepreneurial bent alongside enterprise-scale engineering.
14 years of coding experience
7 years of employment as a software developer
M.Sc., Artificial Intelligence, M.Sc., Artificial Intelligence at The University of EdinburghB.Sc., Physics, Maths, Computer Science, B.Sc., Physics, Maths, Computer Science at Durham University
Github Skills (94)
python10
json-schema10
automation10
home-assistant10
rest-api10
schema10
monitoring10
avro10
mqtt10
home-automation10
json10
garden10
iot10
confluent10
internet-of-things10
Programming languages (7)
Github contributions (5)
danharvey/home-assistant-core
Nov 2023 - Jan 2025
:house_with_garden: Open source home automation that puts local control and privacy first.
Contributions:1 PR, 6 pushes in 1 year 2 months
EqualMedia/dockerfile-oraclejdk
Sep 2014 - Apr 2015
Contributions:13 commits, 6 PRs, 4 pushes in 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.