Principal Software Engineer at The Apache Software Foundation
Bengaluru, Karnataka, India
Join Prog.AI to see contacts
Join Prog.AI to see contacts
Summary
🤩
Rockstar
🎓
Top School
Surendra Lilhore is a Principal Software Engineer with a deep 12-year focus on big data and distributed systems, currently shaping Spark performance for Microsoft Fabric by optimizing Velox and Gluten. An Apache Hadoop PMC member and committer, he has contributed 100+ patches to HDFS and driven features such as Storage Policy Satisfier, Router Federation, erasure coding, and Inotify that improve scale and reliability. His background includes leading Flink and Hadoop teams at Azure HDInsight and Huawei, where he engineered heartbeat optimizers, observer reads for federation, and HA solutions using BookKeeper and ZooKeeper to support 10,000+ DataNodes. Equally comfortable in cloud-native environments, he brings hands-on expertise with Kubernetes, Docker, Kerberos, and operational tooling for large clusters. Notably, his open-source work on improving DistCp, crypto handling, and HDFS usability reflects a sustained commitment to production-grade, community-driven storage infrastructure.
8 years of coding experience
9 years of employment as a software developer
Rajiv Gandhi Proudyogiki Vishwavidyalaya
Bachelor of Computer Application(BCA), Bachelor of Computer Application(BCA) at Makhanlal Chaturvedi National University of Journalism and Communication, Bhopal
Contributions:35 reviews, 167 commits, 29 PRs in 5 years 3 months
Contributions summary:Surendra primarily contributed to the Apache Hadoop project, specifically focusing on HDFS enhancements. Their work involved implementing features like schema-based paths for StoragePolicyAdmin and updating Distcp's delete option usage. The user also addressed issues such as proper exception handling in the crypto command for EZ directories and fixing a shell command timeout. These contributions demonstrate a focus on improving HDFS functionality and usability.
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Surendra Lilhore - Principal Software Engineer at The Apache Software Foundation