Mark Winter is a Senior Software Engineer with 12 years' experience building and operating cloud-native infrastructure and AI model serving platforms, most recently enabling Kubernetes platform tooling at The Trade Desk and previously running Naver Search’s AI Cloud serving over a billion inferences per day. He combines deep systems and MLOps expertise—Kubernetes, Istio, Knative, KServe, Kubeflow—with hands-on Golang, C++ and gRPC development to deliver low-latency, highly observable services. Mark has strong infra automation skills (Terraform, ArgoCD, Flux2) and a track record of improving CI/CD and platform reliability across startups and large orgs. An active open-source contributor, he made substantive KServe and Tox networking enhancements including Ray support and cloud event handling. Based in London with prior South Korea experience and a residential F-visa, he brings a global perspective to scaling AI systems and pragmatic tooling.
12 years of coding experience
9 years of employment as a software developer
BSc Hons Computer Science, BSc Hons Computer Science at Lancaster University
Standardized Serverless ML Inference Platform on Kubernetes
Role in this project:
MLOps Engineer
Contributions:24 reviews, 18 commits, 23 PRs in 1 year 4 months
Contributions summary:Mark primarily contributed to the KServe platform by modifying and enhancing core components related to model serving and deployment. Their work involved integrating new features for handling model extensions and managing cloud event responses, specifically focusing on returning JSON responses. Furthermore, the user updated the project to support Ray deployments, including tests, and improved cloud event handling. Finally, the user reorganized the codebase by moving handlers into separate files.
Contributions:37 commits, 13 comments, 1 issue in 22 days
Contributions summary:Mark's contributions primarily involve modifying and extending the core functionality of the Tox messaging application. They made changes to the networking code, including error checking and socket initialization. The user also added multi-threading to prevent user input from blocking the network and implemented features for friend management such as listing and deleting. These changes suggest a focus on improving the application's usability and underlying functionality.
dhtp2pcommunicationspeer-to-peertox
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Mark Winter - Senior Software Engineer at The Trade Desk