Shivam Khare is a machine learning and systems-focused software engineer with six years of experience building scalable AI infrastructure and real-time vision systems, currently a Member of Technical Staff at xAI in the San Francisco Bay Area. He blends research and production engineering—having worked on embedded computer vision at Samsung, contributed deadline-aware queuing and SLO support to the high-profile Ray distributed AI runtime, and served as a senior engineer at Twitter. Pursuing a master’s in Computer Science at Georgia Tech, he has research experience in optical graph recognition and category-theory-based deep learning and has taught graduate-level behavioral imaging. Comfortable across backend, DevOps, and research roles, Shivam brings an uncommon combination of agentic LLM infrastructure reliability work and hands-on systems delivery.
6 years of coding experience
8 years of employment as a software developer
Indian Institute of Technology Delhi (IIT Delhi)
Master's degree, Computer Science, Master's degree, Computer Science at Georgia Institute of Technology
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Role in this project:
Back-end Developer & DevOps Engineer
Contributions:6 reviews, 6 commits, 11 PRs in 1 year
Contributions summary:Shivam primarily focused on enhancing the Ray Serve module by implementing deadline awareness for queries and integrating a pluggable queuing policy. They modified the queueing mechanisms, including the introduction of the `blist` sorted-list implementation for managing deadlines, and added example code demonstrating the new features. In addition, the user contributed to the CI/CD setup by adding required dependencies like `blist` in the `install-dependencies.sh` script, suggesting DevOps contribution. Furthermore, they added support for both relative and absolute Service Level Objectives (SLOs) via HTTP requests.
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.