Joel P
Senior Data Engineer
Pickering, Ontario, Canada
Summary
👤
Senior🎓
Top SchoolJoel P is a Senior Data Engineer with a decade of experience building end-to-end cloud data platforms across AWS and Azure, specializing in Python, PySpark, SQL, and infrastructure-as-code with Terraform/Terragrunt. He has deep practical expertise in data warehousing and ETL—designing star and snowflake schemas, developing SSIS packages, and migrating on-premise SQL systems to ADLS Gen2, Databricks, and Azure Synapse. At Deloitte he implemented production-grade pipelines using Glue, Redshift, Step Functions, Lambda and OpenSearch dashboards while enforcing least-privilege IAM and automated observability. Joel combines hands-on scripting (Bash, Shell), T-SQL tuning, and ADF/Azure Logic Apps orchestration to solve complex ingestion and orchestration challenges for finance clients. He’s equally comfortable translating stakeholder requirements into technical designs and automating deployments, and he often builds custom logging and monitoring to make data pipelines auditable and resilient.
10 years of coding experience
3 years of employment as a software developer
Bachelor of Technology - BTech, Computer Science, Bachelor of Technology - BTech, Computer Science at Vidya Jyothi Institute Of Technology
English, Spanish
Github Skills (25)
command-line-interface10
azure-cli10
windows-subsystem-for-linux10
azure9
piaware7
uat7
wireless6
forwarding5
fltk5
zwave5
docker-container5
linux4
windows4
device-driver4
iot3
Programming languages (7)
Github contributions (5)
idatum/hass2mqtt
Oct 2021 - Sep 2025
Home Assistant events published to MQTT with WebSocket API state_changed JSON as topic payload.
Contributions:2 PRs, 23 pushes, 4 branches in 3 years 11 months
apidotneteventsassistantpayload
idatum/idatum.github.io
Sep 2022 - May 2025
Contributions:84 pushes, 3 branches in 2 years 8 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.