Shashikant Banerjee
Consulting Member Of Technical Staff at The Apache Software Foundation
California, United States
Summary
🤩
Rockstar🎓
Top SchoolShashikant Banerjee is a seasoned distributed-systems engineer with over 12 years designing and building large-scale data and AI infrastructure, currently a Consulting Member of Technical Staff at Oracle Cloud. He specializes in distributed file systems, cloud-native data platforms, and high-throughput big data pipelines, with hands-on experience validating block commit semantics and optimizing container-level storage behavior. An active Apache committer and PMC member across Ratis, Hadoop, and Ozone, he has improved Raft consensus robustness and helped harden Ozone/Hadoop block/BCSID handling—work that directly impacts reliability for cluster-scale storage. Based in California, he blends production-grade backend engineering with open-source stewardship, publishing architecture-focused pieces on Ozone integration in the Hadoop ecosystem. Notably, his contributions include leader-election and client-metrics in Ratis and pragmatic fixes enabling small-file transactions in Ozone/Hadoop, showing a focus on both performance and correctness. He holds a BE in Electronics and Communications from Ramaiah Institute of Technology and brings a pragmatic, detail-oriented approach to solving complex distributed problems.
8 years of coding experience
13 years of employment as a software developer
Bachelor of Engineering (BE) Electronics and Communications Engineering, Bachelor of Engineering (BE) Electronics and Communications Engineering at Ramaiah Institute Of Technology12th Science, 12th Science at D.A.V Public School
Hindi, English
Github Skills (17)
ozone10
container-management10
back-end-development10
testing10
distributed-systems10
java10
data-storage10
javas10
block-storage10
raft10
raft-protocol10
metric10
hdfs9
error-handling9
concurrency9
Programming languages (3)
Github contributions (5)
apache/ozone
Oct 2018 - Jan 2022
Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:381 reviews, 151 commits, 240 PRs in 3 years 3 months
Contributions summary:Shashikant contributed code to validate Block Commit Sequence IDs (BCSIDs) when reading blocks from containers in the datanodes. Their work included modifying the BlockManagerImpl class to perform BCSID validation during read operations and implementing tests to verify the correct handling of valid and invalid BCSIDs. Further, they contributed by adding a function to validate and update the BCSID for PutSmallFile/GetSmallFile command and also added the logic to distribute open containers among the pipelines of a datanode.
scalableredundantapachebig-dataspark
apache/hadoop
Apr 2018 - Sep 2021
Apache Hadoop
Role in this project:Back-end Developer
Back-end DeveloperContributions:25 reviews, 149 commits, 112 PRs in 3 years 5 months
Contributions summary:Shashikant contributed to validating block commit sequence IDs (BCSID) in the container service, specifically within the KeyValueContainer and BlockManagerImpl classes. They added checks to ensure BCSID consistency during block reads and writes, including the addition of new exception results to handle BCSID mismatches. Furthermore, the user made updates to support getSmallFile/putSmallFile transactions and added improvements in the Ratis layer. The user also made changes to the BlockID and BlockOutputStream class.
apachebig-datasparkhadoopjava
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.