Richard Gilmore
Staff Data Engineer
Belfast Metropolitan Area United Kingdom
Summary
👤
Senior🎓
Top SchoolRichard Gilmore is a Staff Data Engineer with 11+ years building scalable, cost-efficient data platforms and pipelines, specialising in Spark, Kafka, and AWS-native architectures. He has led migrations from Databricks to EMR Serverless, Glue and Athena, deployed Kafka Connect and Flink on Kubernetes, and architected CI/CD that manages 500+ production jobs orchestrated by Airflow. At Slice he moved teams toward event-driven and stream-processing models, introduced metadata and lineage via OpenMetadata, and championed data mesh ownership across product engineering. He combines deep hands-on engineering with people leadership, having expanded and mentored data science, platform, and analytics engineers while remaining active in technical architecture. Richard also contributes to open-source tooling around Spark Connect, Terraform Python deployments, and AWS credential handling—practical fixes that surface across data tooling ecosystems. Based in Belfast, he brings an uncommon mix of operational rigour, cost-focused design, and applied ML/LLM experimentation to data engineering problems.
10 years of coding experience
12 years of employment as a software developer
Master's degree Computer Science and Electronics, Master's degree Computer Science and Electronics at Queen's University BelfastAlevels, Alevels at Dalriada
English
Stackoverflow
596reputation
74kreached
8answers
0questions
Github Skills (184)
postgresql10
alien10
operation10
python10
databases10
duckdb10
data-pipeline10
combinations10
stm32cube10
cmsis10
ipython-magic10
pipeline10
beancount10
debugging10
bigquery10
Programming languages (10)
Github contributions (5)
gilcloud/sbt-gitlab
Apr 2020 - Nov 2022
sbt plugin to allow dependency resolution and artifact publishing for gitlab
Contributions:3 releases, 21 commits, 17 PRs in 2 years 7 months
publishingresolutiongitlabsbt-pluginscala
gilandose/prezto
Dec 2016 - Nov 2022
The configuration framework for Zsh
Contributions:3 PRs, 11 pushes in 5 years 11 months
shellconfiguration-frameworkzsh-pluginzsh
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.