Varun Saxena is a Staff Software Engineer with 11 years of experience designing and implementing large-scale, fault-tolerant distributed systems, currently driving YARN and big data platform work at LinkedIn. He previously led Hadoop kernel and YARN teams at Huawei, contributing over 40 KLOC to Apache Hadoop as a PMC member and committer and ranking among the project's top contributors. His work spans core Java/C++ systems, HDFS/HBase, scheduler design (including GPU-aware scheduling and a Superior Scheduler), and production-grade CI/CD and performance tuning for tools like Dr. Elephant. Varun blends hands-on coding with technical leadership—running pre-research, security/STRIDE analysis, patent filings, and community-driven feature efforts such as ATSv2. Based in Bengaluru, he pairs strong academic foundations (MCA with top grades and a CMU summer course) with practical impact across cloud and telecom domains.
11 years of coding experience
1 year of employment as a software developer
Thapar Institute of Engineering and Technology
Summer Course, Computer Science, Summer Course, Computer Science at Carnegie Mellon University
Contributions:335 commits, 1 PR, 2 pushes in 3 years 9 months
Contributions summary:Varun primarily contributed to the backend of the Hadoop YARN project. Their commits focused on fixing bugs related to the Resource Manager (RM) and enhancing existing features, such as adding RPC port info in RM web service's response when getting app status and avoiding stack traces when recovering an app. The user's work also involved addressing intermittent test failures, and implementing changes to facilitate AM blacklisting and handling of the new ATSv2 features for the project.
Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
Role in this project:
Backend & DevOps Engineer
Contributions:21 commits, 25 PRs, 39 pushes in 4 months
Contributions summary:Varun primarily contributed to the Dr. Elephant project by addressing critical issues related to job backfilling, ensuring data integrity during system downtime. They refactored code to improve the performance of the application, integrating Findbugs and CPD for improved code quality. Additionally, they were involved in the development of CI/CD pipelines and added metrics to monitor system performance.
performance-monitoringelephantapachebig-dataspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Varun Saxena - Staff Software Engineer at LinkedIn