Sandeep Katta
Software Engineer at Huawei Cloud Türkiye
Bengaluru, Karnataka, India
Summary
👤
Senior🎓
Top SchoolSandeep Katta is a software engineer with 8 years' experience specializing in Apache Spark, big data ecosystems (Hadoop, YARN, Hive) and cloud optimizations, currently improving Spark performance for Huawei Cloud Türkiye. A long-time Apache Spark contributor, he has fixed core executor allocation, CSV handling and shuffle block issues and implemented features like array_compact in one of the most widely used big-data engines. His background includes backline engineering roles at Databricks and multiple senior technical and architecture positions at Huawei, equipping him to operate effectively as an individual contributor or collaborative team member. Based in Bengaluru, he combines hands-on systems work with production-focused tuning for large-scale distributed processing—often surfacing subtle Spark internals that improve real-world reliability and efficiency.
8 years of coding experience
8 years of employment as a software developer
Bachelor of Engineering (B.E.), Computer Science, A, Bachelor of Engineering (B.E.), Computer Science, A at BVBCET
Hindi
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (9)
javas10
big-data10
spark10
sql10
java10
scala10
testing9
debug9
debugging9
Programming languages (2)
Github contributions (5)
apache/spark
Feb 2019 - Apr 2021
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Back-end DeveloperContributions:28 reviews, 6 commits, 45 PRs in 2 years 2 months
Contributions summary:Sandeep primarily contributed to the Apache Spark core, addressing various issues related to executor allocation, data processing, and SQL functionalities. Their work involved fixing bugs in the ExecutorAllocationManager, resolving issues with CSV file handling, and correcting inconsistencies in shuffle block construction. They also enhanced the system by implementing features, such as array_compact, to improve the usability of the functions.
analyticspythondata-processingsqlapache
sandeep-katta/spark
Feb 2018 - Apr 2023
Mirror of Apache Spark
Contributions:2 PRs, 185 pushes, 44 branches in 5 years 2 months
spark-mlapachebig-datasparkscala
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.