Claire Mcginty
Senior Data Engineer
New York, New York, United States
Summary
🤩
Rockstar🎓
Top SchoolClaire Mcginty is a Senior Data Engineer with 13 years of experience building and maintaining large-scale data infrastructure, currently contributing to Spotify’s open-source stack from New York. She combines deep backend engineering expertise in Java and Scala with hands-on work on Apache Beam, Parquet, and Spotify’s Scio—improving Pub/Sub integration, Avro/Parquet interoperability, and streaming job patterns. At LinkedIn she helped scale content recommendation pipelines using Kafka, Samza, and Hadoop, and she brings practical production-focus from end-to-end pipeline design to performance and I/O optimizations. Claire’s history of open-source contributions shows a pattern of shipping robust, testable integrations for cloud dataflow systems, and she often surfaces subtle schema and encoding fixes that prevent downstream data loss.
12 years of coding experience
4 years of employment as a software developer
Bachelor of Science (B.S.), Electrical Engineering and Computer Science, Bachelor of Science (B.S.), Electrical Engineering and Computer Science at University of California, Berkeley
Stackoverflow
46reputation
677reached
1answer
0questions
Github Skills (34)
avro10
google-cloud-platform10
conversions10
data-conversion10
dataflow-programming10
bigquery10
data-pipelines10
dataflow10
python10
data-engineering10
data-serialization10
luigi10
hadoop10
apache10
java10
Programming languages (6)
Github contributions (5)
spotify/scio
Mar 2018 - Jan 2023
A Scala API for Apache Beam and Google Cloud Dataflow.
Role in this project:
Back-end Developer & Data Engineer
Back-end Developer & Data EngineerContributions:9 releases, 533 reviews, 240 commits in 4 years 11 months
Contributions summary:Claire primarily contributed to back-end and data-engineering related tasks. They modified the default cancelJob value, added examples for streaming jobs with refreshing side inputs, and integrated a new data publishing system to Datastore, particularly for benchmarking results. They also made improvements to the build process and applied updates to dependencies.
apidatabeambatchbigquery
apache/parquet-java
Apr 2023 - Feb 2025
Apache Parquet Java
Role in this project:Back-end Developer
Back-end DeveloperContributions:73 reviews, 14 PRs, 89 comments in 1 year 10 months
Contributions summary:Claire primarily worked on the `parquet-avro` module, focusing on improvements and fixes related to Avro integration with Parquet. Their contributions included handling Avro schema conversion, fixing projections for repeated record types, and supporting extra metadata configuration for the Parquet writer. The user also implemented support for non-grouped repeated fields in the Avro schema converter and made improvements related to logical type conversions for different Avro versions.
avroparquetapachebig-dataapache-parquet
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.