Joel Koshy is a Senior Staff Software Engineer with 13 years of experience building high-throughput data infrastructure, currently at Databricks after a long tenure leading Kafka efforts at LinkedIn. He holds a PhD in Computer Science and combines deep systems research roots with hands-on production engineering across real-time pipelines and messaging systems. As a Kafka PMC member and committer, he has contributed core server improvements to Apache Kafka—optimizing request handling, purgatory mechanisms, metrics, and deadlock fixes—that power large-scale streaming platforms. Joel is comfortable operating at the intersection of reliability, performance, and scale, and has a track record of surfacing subtle infrastructure issues (e.g., socket buffers and consumer offset handling) that materially improve platform stability. Based in the San Francisco Bay Area, he pairs academic rigor with practical delivery across enterprise-grade distributed systems.
13 years of coding experience
20 years of employment as a software developer
PhD Computer Science, PhD Computer Science at University of California, Davis
Contributions:59 commits, 5 PRs, 3 pushes in 3 years 11 months
Contributions summary:Joel contributed to the Apache Kafka project by implementing and refactoring features related to request handling and purgatory mechanisms within the core server components. Their work involved modifications to `RequestPurgatory`, `KafkaApis`, and other server-side classes, indicating a focus on optimizing request processing and managing delayed operations. They also addressed issues related to socket buffer sizes and consumer offset management, demonstrating a strong understanding of Kafka's internal architecture. Furthermore, the user implemented metrics and resolved deadlocks to enhance the stability and performance of the system.
Contributions:12 pushes, 3 branches in 4 years 2 months
kafka-streamsapache-kafkasinkstreamsapache
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Joel Koshy - Senior Staff Software Engineer at Databricks