Karuppayya Rajendran
Principal Software Engineer at Salesforce
San Francisco Bay Area United States
Summary
🤩
Rockstar🎓
Top SchoolKaruppayya Rajendran is a Principal Software Engineer with 11 years of experience building scalable data platforms and performance-focused systems from the Bay Area. He has driven Lakehouse and table management work at Apple and now leads platform-level engineering at Salesforce, combining deep Spark and Apache Iceberg expertise with pragmatic product delivery. He has a strong track record at Qubole scaling Spark features (dynamic filtering, adaptive aggregation, auto-skew detection) and bootstrapping Zeppelin as a service, and he contributes to prominent open-source projects like Apache Zeppelin and Iceberg. Known for hands-on refactors and measurable performance wins, he emphasizes maintainable code, instrumentation, and practical schema evolution. He mentors engineers and moves quickly between back-end systems and full-stack fixes—bringing improvements from UI responsiveness to interpreter integrations. His MTech from BITS Pilani and early work on client tooling and remote debugging reflect a long-standing focus on developer experience as well as runtime efficiency.
11 years of coding experience
14 years of employment as a software developer
BITS Pilani, Birla Institute of Technology and ScienceBachelor of Engineering (B.E.) Computer Science, Bachelor of Engineering (B.E.) Computer Science at Coimbatore Institute of Technology
English, Tamil, Hindi
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (22)
apache-spark10
javascript10
spark10
java10
javas10
angularjs10
apache-iceberg10
schema-changes10
scripting9
testing9
data-engineering9
ui-design9
big-data9
shell9
script9
Programming languages (4)
Github contributions (5)
apache/iceberg
Dec 2020 - Aug 2022
Apache Iceberg
Role in this project:
Back-end Developer
Back-end DeveloperContributions:209 reviews, 18 commits, 45 PRs in 1 year 8 months
Contributions summary:Karuppayya primarily focused on refactoring and enhancing the Apache Iceberg project's Spark integration. Their work included renaming fanout configurations and refactoring schema evolution examples within the Spark 2 and Spark 3 modules. Furthermore, the user implemented the use of constants for read and write options, indicating a commitment to code maintainability and standardization. The user's contributions also involved adding new tests for migration action and adding the functionality to remove reachable files.
apache-icebergapachebig-datadatastreamjava
apache/zeppelin
Jul 2015 - Jul 2017
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
Role in this project:Full-stack Developer
Full-stack DeveloperContributions:49 PRs, 140 comments in 2 years
Contributions summary:Karuppayya primarily contributed to the Apache Zeppelin project by addressing bug fixes, improving the user interface, and enhancing the functionality of the shell interpreter. Their work includes resolving issues related to the interpreter page, improving the performance of the SparkSqlInterpreter, and making the UI more responsive. They also added features such as making paragraph code selectable when running and integrating Spark web UI access from the interpreters page.
data-drivendata-analyticsanalyticsnosqlflink
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.