Alexa Griffith is a Senior Principal Software Engineer based in New York with seven years of experience building and operating production AI and ML inference platforms. She designs and deploys large-scale LLM serving and distributed inference infrastructure using open source tools like KServe, vLLM, llm-d and Envoy AI Gateway, and has deep hands-on experience improving observability—adding Prometheus metrics and labels to KServe’s Python SDK. Previously a senior engineer at Bloomberg and a CNCF advisor, she’s a seasoned platform builder who also communicates technical ideas widely through KubeCon keynotes and public speaking. Beyond engineering, she hosts a podcast and brings a scientific background in computational chemistry and HPC that informs her methodical approach to system performance and reliability.
7 years of coding experience
9 years of employment as a software developer
Diploma, College/University Preparatory and Advanced High School/Secondary Diploma Program, Diploma, College/University Preparatory and Advanced High School/Secondary Diploma Program at Clarksville Academy
Bachelor of Applied Science - BASc, Chemistry ACS, Bachelor of Applied Science - BASc, Chemistry ACS at University of Tennessee, Knoxville
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Role in this project:
MLOps Engineer
Contributions:170 reviews, 11 commits, 23 PRs in 3 months
Contributions summary:Alexa primarily focused on enhancing the KServe platform's metrics and monitoring capabilities. They integrated Prometheus metrics into the Python SDK for custom transformers and model servers. Furthermore, the user worked on adding support for Prometheus labels, aligning metrics with serverless infrastructure, and adding a V2 model ready endpoint. These changes improved the platform's observability and manageability.
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
Contributions:1 PR, 244 pushes, 18 branches in 1 year 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.