Tiago Palma
Principal Data Engineer
London, England, Portugal
Summary
👤
Senior🎓
Top SchoolTiago Palma is a Principal Data Engineer based in London with over a decade of experience designing and operating large-scale streaming and batch data platforms across fintech, telecoms, retail and startups. He has led teams and platform initiatives—from standing up Kafka ecosystems and CI/CD-driven schema management at Inter IKEA to building streaming ETL and analytics platforms at Worldpay and Dataffirm—often coding in Scala and Java and automating deployments with Docker and Kubernetes. Comfortable in both startup and enterprise contexts, he combines hands-on development (Kafka Streams, Spark, Avro, schema registry) with architectural ownership of data distribution and observability. He has a track record of open-source-minded work (Gerrit plugins and devops analytics) and a practical curiosity—early Hadoop experiments on Raspberry Pis hint at his habit of prototyping systems end-to-end.
11 years of coding experience
8 years of employment as a software developer
Licentiate Telecommunications and Computer Engineer, Licentiate Telecommunications and Computer Engineer at ISCTE - Instituto Universitário de LisboaHigh School High School/Secondary Diplomas and Certificates, High School High School/Secondary Diplomas and Certificates at American School of Warsaw
Portuguese, English, Italian, Spanish, French
Stackoverflow
29reputation
292reached
0answers
1question
Github Skills (26)
monitor10
python10
data-science10
data-engineering10
machine-learning10
workflow-engine10
apache10
scheduler10
etl10
automation10
mlops10
orchestration10
data-pipelines9
apache-airflow9
elt9
Programming languages (3)
Github contributions (5)
GerritForge/docker-registry
Jun 2015 - Jun 2015
Contributions:4 commits in 1 day
tiago-palma/airflow
Sep 2020 - Sep 2020
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Contributions:4 pushes, 1 branch in 1 day
monitoremrapachedata-engineeringetl
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.