Mark Grey is a Senior Staff Software Engineer in New York with 13 years building large-scale, data-intensive systems and a decade-plus commitment to continuous learning. He specializes in petabyte-scale data processing, instrumentation for experimentation, and content recommendation platforms, with deep hands-on experience in Scala, Java/JVM, and Python. At Spotify he progressed from engineer to senior staff while driving backend infrastructure and analytics capabilities that power personalization at scale. An active open-source contributor, he improved BigQuery integration in the widely used Luigi workflow tool and extended Scala AWS tooling to better handle complex DynamoDB types—work that reflects a practical focus on reliability and interoperability. Colleagues know him as a technical leader who pairs rigorous engineering with iterative problem-solving and a growth mindset.
Contributions:5 commits, 3 PRs, 6 comments in 10 months
Contributions summary:Mark focused on enhancing the awscala library for interacting with AWS DynamoDB. Their contributions included adding support for nested maps and lists within the DynamoDB attribute value structures. They also implemented boolean data type support. These changes improve the library's compatibility with complex data structures and increase the functionality.
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Role in this project:
Back-end Developer
Contributions:11 commits, 13 PRs, 5 pushes in 3 months
Contributions summary:Mark primarily contributed to the BigQuery integration within the Luigi framework. Their work included implementing atomic BigQuery uploads, adding a method to get the table's URI, and writing tests. They also reverted and re-implemented the atomic BigQuery uploads feature, indicating iterative development and debugging within this specific area of the project. These changes suggest a focus on improving the functionality and reliability of the BigQuery integration.
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.