Joel Koshy

Senior Staff Software Engineer at Databricks

San Francisco Bay Area United States
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts

Summary

🤩
Rockstar
🎓
Top School
Joel Koshy is a Senior Staff Software Engineer with 13 years of experience building high-throughput data infrastructure, currently at Databricks after a long tenure leading Kafka efforts at LinkedIn. He holds a PhD in Computer Science and combines deep systems research roots with hands-on production engineering across real-time pipelines and messaging systems. As a Kafka PMC member and committer, he has contributed core server improvements to Apache Kafka—optimizing request handling, purgatory mechanisms, metrics, and deadlock fixes—that power large-scale streaming platforms. Joel is comfortable operating at the intersection of reliability, performance, and scale, and has a track record of surfacing subtle infrastructure issues (e.g., socket buffers and consumer offset handling) that materially improve platform stability. Based in the San Francisco Bay Area, he pairs academic rigor with practical delivery across enterprise-grade distributed systems.
code13 years of coding experience
job20 years of employment as a software developer
bookPhD Computer Science, PhD Computer Science at University of California, Davis
bookIndian Institute of Technology Madras
bookAbu Dhabi Indian School
github-logo-circle

Github Skills (8)

javas10
apache-kafka10
back-end-development10
request-handler10
java10
scala10
zookeeper9
metric9

Programming languages (3)

JavaShellPython

Github contributions (5)

github-logo-circle
apache/kafka

Dec 2012 - Nov 2016

Mirror of Apache Kafka
Role in this project:
userBack-end Developer
Contributions:59 commits, 5 PRs, 3 pushes in 3 years 11 months
Contributions summary:Joel contributed to the Apache Kafka project by implementing and refactoring features related to request handling and purgatory mechanisms within the core server components. Their work involved modifications to `RequestPurgatory`, `KafkaApis`, and other server-side classes, indicating a focus on optimizing request processing and managing delayed operations. They also addressed issues related to socket buffer sizes and consumer offset management, demonstrating a strong understanding of Kafka's internal architecture. Furthermore, the user implemented metrics and resolved deadlocks to enhance the stability and performance of the system.
apache-kafkakafka-consumerapachescalakafka
jjkoshy/kafka

Feb 2016 - Mar 2020

Mirror of Apache Kafka
Contributions:12 pushes, 3 branches in 4 years 2 months
kafka-streamsapache-kafkasinkstreamsapache
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Joel Koshy - Senior Staff Software Engineer at Databricks