Shane Knapp
DevOps Technical Lead at Cal-ICOR
Berkeley, California, United States
Summary
🤩
Rockstar🎓
Top SchoolShane Knapp is a DevOps technical lead with 11 years of experience building and operating large-scale CI/CD, GPU, and big-data infrastructure for research and education across UC Berkeley and California higher-education systems. He has led teams deploying managed JupyterHub at scale for community colleges, Cal States, and UCs and served as UC Berkeley DataHub technical lead and a manager supporting multiple EECS research labs. A long-time Apache Spark committer and contributor, Shane specializes in build and test automation—improving Spark’s CI, Python testing, and Java 11 support—and runs bare-metal and Jenkins-based QA systems for genomics and large-scale computation. Known as a pragmatic "builder of things" and voice of reason, he pairs deep systems expertise with hands-on scripting and tooling to keep complex pipelines reliable. Based in Berkeley, he brings institutional-scale operational experience plus a curious, interdisciplinary background spanning computer science, math, archaeology, and photography.
11 years of coding experience
22 years of employment as a software developer
almost got 4! :), archaeology, computer science, mathematics, photography, almost got 4! :), archaeology, computer science, mathematics, photography at University at Buffalo
Github Skills (16)
sh10
jenkins10
automation10
script10
jenkins-ci10
build-system10
shell10
automations10
scripting10
cicd10
testing9
python9
javas8
infrastructure-management8
java8
Programming languages (12)
Github contributions (5)
apache/spark
Aug 2018 - Nov 2020
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
DevOps Engineer & Automation Engineer
DevOps Engineer & Automation EngineerContributions:3 reviews, 8 commits, 51 PRs in 2 years 3 months
Contributions summary:Shane primarily focused on improving the build and test infrastructure of the Apache Spark project. Their contributions include updating Python versions used in testing, modifying build scripts to accommodate Apache's repository migration, and implementing Java 11 support for pull request builds. They also addressed build issues, such as fixing timeouts and resolving errors in test execution. A significant portion of their work involved refactoring and enhancing the automation framework for CI/CD pipelines, primarily using shell scripts and Jenkins configuration.
analyticspythondata-processingsqlapache
shaneknapp/rise-infra
May 2017 - May 2022
tools and scripts used to help manage RISELab infrastructure
Contributions:2 PRs, 75 pushes, 68 branches in 5 years
infrastructureinfrastructure-management
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.