Thomas Graves
Principal Distributed System Software Engineer at The Apache Software Foundation
Urbana-Champaign Area United States
Summary
🤩
Rockstar🎓
Top SchoolThomas Graves is a Principal Distributed System Software Engineer with 14+ years building and hardening large-scale data infrastructure, currently driving distributed systems work at NVIDIA. He combines deep low-level expertise—Linux kernel, device drivers, RTOS, ARM assembly—with broad big-data proficiency in Hadoop and Spark, where he is a long-standing committer and PMC member. At Yahoo/Oath he led Spark and Jupyter efforts that enabled internal data science workflows, and his open-source contributions include security and MapReduce fixes to Apache Hadoop and HDFS/Spark integrations used widely in production. He also contributes to high-performance projects like rapidsai/cudf, improving CSV parsing and GPU-backed data pipelines, reflecting a rare blend of systems, data-processing, and GPU-aware engineering. Known for strong debugging instincts and mentoring, he pairs pragmatic problem solving with sustained community leadership inside the Apache Foundation.
14 years of coding experience
20 years of employment as a software developer
University of Illinois Urbana-Champaign
Github Skills (32)
hadoop-mapreduce10
csv-parse10
c-language10
spark10
back-end-development10
dataframes10
big-data10
cudf10
mapreduce10
hadoop10
java10
dataframe10
security10
scala10
javas10
Programming languages (9)
Github contributions (5)
apache/spark
Dec 2017 - Mar 2022
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Back-end DeveloperContributions:482 reviews, 15 commits, 94 PRs in 4 years 4 months
Contributions summary:Thomas's contributions centered around debugging and improving the Apache Spark HDFS integration, including fixing tests. They addressed issues in the core of the Spark project, focusing on improving the interaction between Spark and Hadoop's HDFS. Furthermore, the user made changes to the codebase around the resource profiles and adding additional GPU support in the system. They improved and added features to the K8S setup related to resource allocation and configuration.
analyticspythondata-processingsqlapache
apache/hadoop
Feb 2012 - May 2015
Apache Hadoop
Role in this project:Backend Developer
Backend DeveloperContributions:250 commits, 2 comments in 3 years 3 months
Contributions summary:Thomas's commits focus on enhancing the security and functionality of the Apache Hadoop project. They implemented changes to the credential merging process within the security module, enabling credential merging functionalities. Furthermore, the user addressed a number of issues in the MapReduce system, including a fix for task timeouts. The user also worked on updates and corrections to the Job History Server's web services, contributing to improved functionality and security.
apachebig-datasparkhadoopjava
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.