Ed Elliott
Data Engineering Consultant
Wealden, England, United Kingdom
Summary
🤩
RockstarEd Elliott is a seasoned data engineering consultant with 12+ years delivering Azure and cloud data solutions, including ADF, Databricks, SQL DW and Power BI, and has held senior, lead and architect roles across consulting and enterprise teams. He champions engineering quality through TDD, automated testing, CI/CD and operational monitoring, blending development, data and ops expertise to design, deploy and maintain secure, production-grade pipelines. A regular speaker and writer on ETL testing, he also contributes to the prominent dotnet/spark project—adding APIs and ML feature support—demonstrating hands-on proficiency with Spark for .NET. Based in Wealden, UK, he combines practical migration experience (on-prem to Azure), DevOps automation and a penchant for making complex data platforms auditable and testable.
12 years of coding experience
21 years of employment as a software developer
Stackoverflow
6,726reputation
425kreached
256answers
0questions
visual-studio
top-5%
sql-server
top-5%
Github Skills (21)
apache-spark10
net10
dataframes10
machine-learning10
dotnet10
analytics10
dataframe10
asp-net10
dotnet-core10
csharp10
big-data9
visual-studio9
sql9
sql-server9
netcore8
Programming languages (12)
Github contributions (5)
dotnet/spark
Apr 2019 - Nov 2020
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:37 reviews, 20 commits, 37 PRs in 1 year 6 months
Contributions summary:Ed primarily contributed to the implementation and enhancement of .NET for Apache Spark features. Their work involved porting Python examples into C#, specifically focusing on data source examples. The user also implemented the `IsIn` method for the `Column` class, adding functionality for checking if a column's value is present within a given list of values. Further, they contributed to the implementation of the `SparkSession.Range` API and implemented the `SparkSession.Catalog`. Finally, the user added support for various ML features like `Bucketizer`, `TF-IDF`, `Word2Vec`, `CountVectorizer` and exposed related constructors.
emrfsharpmicrosofttpchbigdata
GoEddie/SQLCover
Apr 2016 - Oct 2019
Contributions:4 releases, 98 commits, 28 PRs in 3 years 7 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.