Rajarshi Sarkar is a senior software engineer with over a decade of experience building scalable, high-performance distributed systems across Google, Amazon Web Services, and Walmart, with deep expertise in Java, Big Data, microservices, and cloud-native storage. He helped power petabyte-scale analytics on AWS EMR—optimizing Hive partition pruning, integrating Apache Iceberg and making S3A the default filesystem—while contributing back to prominent open-source projects like Apache Iceberg and Trino. At Walmart he designed a cumulative data repository and a suite of Data Lake products focused on real-time integration, governance, and lineage, demonstrating both product-minded architecture and hands-on implementation. His background in big data systems (MS from Arizona State) and contributions to Iceberg’s S3/Glue integrations reveal a strong operational focus on real-world cloud data management and metadata hygiene. Colleagues rely on him to translate complex distributed-data problems into production-ready, performant solutions.
11 years of coding experience
9 years of employment as a software developer
Master of Computer Science Big Data Systems, Master of Computer Science Big Data Systems at Arizona State University
Bachelor of Engineering Information Technology, Bachelor of Engineering Information Technology at Birla Institute of Technology, Mesra
Contributions:252 reviews, 44 commits, 47 PRs in 1 year 2 months
Contributions summary:Rajarshi made contributions focused on improving the AWS S3 integration and the Glue catalog integration within the Apache Iceberg project. Their work included adding functionality to create staging directories, adding column parameters to the Glue catalog table schema, and adding table-level S3 tags for enhanced object management. They also contributed to backporting features to support stream reading and skipping overwrites. These contributions suggest expertise in AWS services and data management operations.
This repository contains some projects that I have worked on.
Contributions:50 commits in 1 year 7 months
javapythoncpp
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.