Pedro Fernandes
Data Engineer Databricks Python
Barcelos, Portugal
Summary
🤩
Rockstar🎓
Top SchoolPedro Fernandes is a seasoned Data Engineer with a decade of experience designing and delivering large-scale data pipelines across finance, insurance, telecommunications, and travel industries. He specializes in Databricks, Spark (Scala and PySpark) and Python, with a strong cloud and orchestration background including Azure, Kubernetes, Airflow and Argo. Pedro has repeatedly held technical lead roles processing high-throughput event streams and sensitive banking datasets, and he combines hands-on engineering with teaching experience as an invited Big Data lecturer. Based in Barcelos, Portugal, he moves fluidly between legacy Java systems and modern Delta Lake architectures, often bridging ETL performance tuning with production reliability. A practical problem-solver, he has scaled systems that process millions of call-trace events and built internal metrics pipelines that inform business decisions.
10 years of coding experience
11 years of employment as a software developer
Universitat Politècnica de ValènciaDegree in Computer Science, Computer Science, Degree in Computer Science, Computer Science at Universidade do Porto
English, Portuguese, Spanish
Stackoverflow
1,879reputation
938kreached
20answers
4questions
spring-boot
top-5%
spring
top-5%
java
top-5%
unit-testing
top-5%
mocking
top-5%
junit
top-5%
Github Skills (48)
python10
cluster-computing10
geospatial10
spatial-analysis10
java10
scala10
spatial-query10
regression-models10
scale10
gis10
espn10
prediction10
unit-testing9
large-scale9
spring9
Programming languages (4)
Github contributions (5)
pedromorfeu/ScalaTraining
Jul 2018 - Feb 2020
Contributions:30 pushes, 1 branch in 1 year 7 months
pedromorfeu/SparkTraining
Jun 2017 - Jul 2018
Contributions:19 pushes, 1 branch in 1 year 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.