Joel P
Senior Data Engineer
Pickering, Ontario, Canada
Summary
👤
Senior🎓
Top SchoolJoel P is a Senior Data Engineer with a decade of experience building end-to-end cloud data platforms across AWS and Azure, specializing in Python, PySpark, SQL, and infrastructure-as-code with Terraform/Terragrunt. He has deep practical expertise in data warehousing and ETL—designing star and snowflake schemas, developing SSIS packages, and migrating on-premise SQL systems to ADLS Gen2, Databricks, and Azure Synapse. At Deloitte he implemented production-grade pipelines using Glue, Redshift, Step Functions, Lambda and OpenSearch dashboards while enforcing least-privilege IAM and automated observability. Joel combines hands-on scripting (Bash, Shell), T-SQL tuning, and ADF/Azure Logic Apps orchestration to solve complex ingestion and orchestration challenges for finance clients. He’s equally comfortable translating stakeholder requirements into technical designs and automating deployments, and he often builds custom logging and monitoring to make data pipelines auditable and resilient.
10 years of coding experience
3 years of employment as a software developer
Bachelor of Technology - BTech, Computer Science, Bachelor of Technology - BTech, Computer Science at Vidya Jyothi Institute Of Technology
English, Spanish
Github Skills (42)
command-line-interface10
azure-cli10
azure10
command-line9
cli9
wsl28
wireless7
piaware7
qbcore-framework7
zwave7
uat7
fltk6
chat6
docker-container6
wave6
Programming languages (6)
Github contributions (5)
idatum/unifi_tracker
Jan 2022 - Jul 2022
Contributions:12 releases, 6 commits, 37 pushes in 6 months
idatum/idatum.github.io
Sep 2022 - Jan 2025
Contributions:83 pushes, 3 branches in 2 years 3 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.