Divij Vaidya
Staff Software Engineer at Databricks
Bengaluru, Karnataka, India
Summary
🤩
Rockstar🎓
Top SchoolDivij Vaidya is a Staff Software Engineer with 14 years of experience building high-performance distributed systems and databases, currently at Databricks after leading foundational work at AWS and major contributions across graph and streaming platforms. He helped architect multi‑$100M products—most notably driving throughput, scaling and recovery improvements for Amazon MSK—and has a track record of shipping reliability and cost optimizations at scale (e.g., CPU reductions in Kafka and tiered storage work that halved customer storage costs). A founding engineer and bootstrapper of global teams, he led Berlin’s Neptune engineering launch and authored major query- and observability-related projects across large data fleets. An active open-source leader, Divij is a PMC member/committer on Apache Kafka and Apache TinkerPop with hundreds of contributions and measurable client/server performance wins (client init from 2046ms to 2ms; WebSocket I/O up 75%). He blends hands-on backend and front-end work—from varint32 encoding improvements in Kafka to UX tweaks on the kafka-site—while routinely driving open-source strategy and incident response for widely used technologies.
14 years of coding experience
4 years of employment as a software developer
Bachelor of Technology (B.Tech.) Information Technology, Bachelor of Technology (B.Tech.) Information Technology at Indian Institute Of Information Technology Allahabad 
Stackoverflow
261reputation
14kreached
8answers
0questions
Github Skills (27)
javascript10
maintenance10
gremlin10
testing10
css10
kafka10
apache10
graph-database10
java10
scala10
javas10
front-end-development10
performance-optimization10
code-cleanup10
html10
Programming languages (4)
Github contributions (5)
apache/kafka
Apr 2022 - Jan 2023
Mirror of Apache Kafka
Role in this project:
Back-end Developer
Back-end DeveloperContributions:1237 reviews, 34 commits, 267 PRs in 9 months
Contributions summary:Divij primarily worked on back-end code related to Kafka's internal systems. Their contributions include modifying and testing the `LogCleanerManagerTest` and `ProducerStateManagerTest` classes, indicating work on log management and producer state handling. They also added integration tests for the `DeleteRecords API` and fixed a flaky test in the topic command integration test, enhancing the functionality and stability of the system. Additionally, they implemented a performance improvement by optimizing the `varint32` encoding and decoding.
apache-kafkakafka-consumerapachescalakafka
apache/tinkerpop
Jun 2019 - Dec 2020
Apache TinkerPop - a graph computing framework
Role in this project:Back-end Developer
Back-end DeveloperContributions:116 reviews, 50 commits, 45 PRs in 1 year 6 months
Contributions summary:Divij primarily contributed to reordering import statements in Java files and fixing a merge issue, indicating involvement in code maintenance and ensuring build stability. The code changes include modifications to several Java files related to the TinkerPop graph computing framework, including core and test files. These changes demonstrate the user's focus on code organization and build processes within the context of the Apache TinkerPop project.
graph-computingtinkerpopgremlin-serverapacheapache-tinkerpop
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.