Ashwin Shankar
Senior Staff Software Engineer at Apple
San Francisco Bay Area United States
Summary
👤
Senior🎓
Top SchoolAshwin Shankar is a Senior Staff Software Engineer in the San Francisco Bay Area with over a decade of hands-on experience designing and operating large-scale data and AI/ML infrastructure for companies like Apple, Slack, and Netflix. He has driven platform migrations and cost- and performance-optimizations at petabyte scale—running thousands of-node clusters, modernizing Spark and Hive ecosystems, and saving millions through automated S3 cleanup tooling. At Apple he now builds control planes for GPU and data workloads using Kubernetes, Crossplane, Flux and Go, while at Slack and Netflix he led Airflow and YARN/Spark improvements that materially increased throughput and fairness. Known for incident leadership and pragmatic architecture, he blends deep distributed-systems engineering with product-focused delivery and has presented technical work at industry conferences. An early contributor to Hadoop YARN and a leader of multi-team efforts since his Cisco days, he pairs strong execution with a knack for operationalizing complex systems.
11 years of coding experience
13 years of employment as a software developer
Bachelor of Technology (B.Tech.) Information Technology, Bachelor of Technology (B.Tech.) Information Technology at National Institute of Technology, AllahabadCertificate in Big Data for Social Good, Certificate in Big Data for Social Good at Harvard Business School OnlineMaster's degree Computer Science, Master's degree Computer Science at University of Illinois Urbana-Champaign
Github Skills (37)
apache-airflow10
apache-spark10
spark10
data-pipelines10
monitor10
python10
data-science10
data-engineering10
r10
big-data10
machine-learning10
workflow-engine10
hadoop10
apache10
jdbc10
Programming languages (3)
Github contributions (5)
ashwinshankar77/spark
May 2015 - Dec 2015
Contributions:3 pushes, 1 branch in 7 months
apachebig-datasparkscalaapache-spark
ashwinshankar77/airflow
Jul 2020 - Jul 2020
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Contributions:3 pushes in 1 day
monitorapacheprogrammaticallyapache-airflowairflow
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.