Jacob Salway is a Senior Software Engineer based in New York with a decade of professional experience spanning data engineering, analytics, and backend/DevOps work. He transitioned from analytics roles into data engineering before joining Rokt, where he progressed to a senior engineering role and focuses on building scalable, production-grade systems. Jacob is an active open-source contributor to projects like kubeflow/spark-operator, where he implemented scheduler integrations, resource limits, and upgrades across Go and Spark versions—demonstrating deep familiarity with Kubernetes and distributed data workloads. He blends hands-on coding, testing and refactoring with operational improvements, and is comfortable handling edge cases that surface in real-world cloud deployments. Trained in computer and data science at the University of Sydney, he brings both analytical rigor and practical engineering to complex data infrastructure challenges.
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Role in this project:
Backend & DevOps Engineer
Contributions:92 reviews, 51 PRs, 211 comments in 1 year 9 months
Contributions summary:Jacob primarily contributed to the development and maintenance of the Kubernetes operator for Apache Spark applications. Their work included implementing features such as emptyDir size limits and integrating the Yunikorn scheduler for gang scheduling. They also made improvements to the codebase by refactoring, adding test cases, and upgrading the codebase to Golang 1.23.1 and later 1.24.1, as well as upgrading Spark to version 3.5.3. Further contributions include fixing ingress capability discovery, and handling edge cases for UI service names.
Contributions:193 pushes, 2 branches in 7 years 5 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.