Software Development Engineer at Amazon Web Services (AWS)
Bengaluru, Karnataka, India
Join Prog.AI to see contacts
Join Prog.AI to see contacts
Summary
🤩
Rockstar
Shwu Ku is a software development engineer specializing in large language model inference, compression, and production-grade GenAI integrations with five years of experience across startups and hyperscalers. Currently at AWS GenAI, she helps deliver high-throughput transformer inference on Bedrock Batch Inference and owns the OpenAI SDK integration that powers hundreds of billions of tokens daily. Previously a founding engineer and senior MLE at Nyun AI, she built end-to-end compression and fast-inference solutions for LLMs and multimodal models, and contributed open-source tools for domain adaptation (Arcee, LangChain). Comfortable moving between research and production, she has a track record of shipping robust features at Amazon and mentoring startups through Google for Startups. Known for tinkering with state-of-the-art LLM inference tricks, she combines systems-level engineering with practical model optimization to make cutting-edge models cost-effective at scale.
:octocat: A Command Line Interface to generate files using templates, organize folders, compile execute and run code. Check out this 👇🏻 repository I maintain using CPCLI 🥷🏻
Contributions:5 reviews, 15 PRs, 31 pushes in 1 year 10 months
Contributions:11 commits, 9 pushes, 1 branch in 16 days
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Shwu Ku - Software Development Engineer at Amazon Web Services (AWS)