Indrajit Bhosale
Senior System Software Engineer at NVIDIA
Seattle, Washington, United States
Summary
🤩
Rockstar🎓
Top SchoolIndrajit Bhosale is a Senior System Software Engineer with 11 years of experience building high-performance systems in C/C++ and Go, currently working on NVIDIA’s disaggregated inference and Triton serving for large multimodal models. His background spans OS and networking infrastructure, storage, and distributed systems with production impact at companies like NVIDIA, Adobe, Cisco, and Arista. He has a track record of improving observability and debug infrastructure—e.g., shipping binary logging and memory-tracking features for Nexus OS—and has contributed test automation to the widely used Triton Inference Server. Comfortable across kernel-level hooks (eBPF), cloud-native platforms, and ML/DL infra, he blends low-level systems thinking with cloud-scale serving requirements. Based in Seattle, he holds advanced CS training from Carnegie Mellon and Stanford and brings a pragmatic focus on reliability and performance when moving models from research to production. A detail that sets him apart is his hands-on experience creating ransomware-detection and change-block-tracking prototypes for Kubernetes using SIEM and eBPF.
11 years of coding experience
10 years of employment as a software developer
St Ursula High School, PuneB.E, Information Technology, B.E, Information Technology at Pune Institute of Computer TechnologyMaster's degree, Computer Science, Master's degree, Computer Science at Carnegie Mellon UniversityMaster's degree, Computer Science, Master's degree, Computer Science at Stanford University
Github Skills (9)
inference10
pytest10
python10
testing10
machine-learning9
deep-learning8
deeplearning-ai8
cloud-computing7
gpu6
Programming languages (4)
Github contributions (5)
triton-inference-server/server
Feb 2024 - Apr 2025
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Role in this project:
QA Engineer / Test Automation Engineer
QA Engineer / Test Automation EngineerContributions:60 reviews, 34 PRs, 200 pushes in 1 year 1 month
Contributions summary:Indrajit primarily contributed to improving the testing framework for the Triton Inference Server. This involved adding new test cases for input validation, ensuring the server correctly handles required and optional input parameters in model requests. Furthermore, the user made changes to the testing infrastructure by introducing new tests for trace settings API and ORCA. The commits demonstrate a focus on comprehensive testing of server functionality and performance.
nvidia-dockernvidiadeep-learninggpuinference
indrajit96/minesweep
Jul 2020 - Jul 2022
Contributions:1 PR, 66 pushes in 2 years
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.