Rahul Amlekar
Principal Product Manager - Agentic Evals And Observability at Bloomberg
San Francisco, California, United States
Summary
🤩
Rockstar🎓
Top SchoolRahul Amlekar is a Principal Product Manager specializing in agent evaluations and observability, currently building a platform at Bloomberg used by 20+ AI teams to validate production agents and MCP-backed tools. He previously spent seven years at Microsoft leading Windows AI APIs and developer platforms for on-device AI—work that powered Copilot+ PC experiences and was highlighted in company keynotes. Rahul’s platform at Bloomberg processes 20M+ events per day and implements innovations like LLM-as-a-judge, agent-as-a-judge scoring, multi-step agent tracing, and regression detection to move beyond static eval datasets. He blends deep engineering roots in cloud and performance from Azure with product leadership, enabling tight collaboration across research, data science, UX, and engineering. A founder who has shipped products end-to-end, he is particularly interested in using agents as simulated clients to test real task outcomes—a practical approach that few teams operationalize at scale. Based in New York, he brings 11 years of experience turning AI research into auditable, production-ready systems.
11 years of coding experience
5 years of employment as a software developer
Science, Science at Delhi Public School, GurgaonStanford Continuing StudiesThe University of Hong Kong (HKU)Software Eng & ML, Software Eng & ML at McGill University
English, French, Hindi, Marathi
Github Skills (34)
ios10
xaml10
windows10
uwp10
bots10
xamarin10
adaptive-cards10
windows-uwp10
exchange10
android10
bot-framework10
wpf10
flutter9
powershell9
arm9
Programming languages (7)
Github contributions (5)
rahulamlekar/AdaptiveCards-1
Oct 2021 - Jan 2022
A new way for developers to exchange card content in a common and consistent way.
Contributions:10 pushes, 2 branches in 3 months
exchangestashandroidconsistentfor-developers
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.