Marius Van Niekerk
Principal Systems Architect at InMarket
New York, New York, United States
Summary
🤩
Rockstar🎓
Top SchoolMarius Van Niekerk is a founding engineer and full-stack data platform expert with 11 years of experience building resilient, production-ready systems that bridge data science and software engineering. He combines an academic background in mathematical statistics with hands-on work on distributed compute, Kubernetes operators, gRPC services, and the Apache Arrow ecosystem to move experimental code into scalable platforms. Marius has led platform and services teams at companies like Voltron Data and Flatiron Health, modernizing ETL pipelines, driving Snowflake adoption, and building benchmarking and deployment tooling for GPU-accelerated workloads. An active open-source contributor, he’s improved critical projects such as impyla, conda-build, BinderHub, mamba and s3fs—work that spans database clients, package build tooling, cloud notebook orchestration, and S3 encryption handling. He favors rapid iteration to get working solutions live, yet designs systems with operability and backwards compatibility in mind. Based in New York, he’s equally comfortable diving into legacy codebases or picking up new languages and tools to solve large-scale data problems.
11 years of coding experience
18 years of employment as a software developer
Master of Science Mathematical Statistics, Master of Science Mathematical Statistics at Stellenbosch University
English, Afrikaans
Github Skills (63)
dependency-management10
git10
notebook10
conda-forge10
conda-build10
docker10
c-language10
boto10
continuous-integration10
python10
package-management10
jupyter10
configuration-management10
fest10
conda10
Programming languages (19)
Github contributions (5)
apache/incubator-toree
May 2016 - Mar 2017
Mirror of Apache Toree (Incubating)
Role in this project:
Back-end Developer
Back-end DeveloperContributions:38 commits, 14 PRs, 134 comments in 9 months
Contributions summary:Marius primarily contributed to the Apache Toree project by adding features related to dependency management and configuration. Their commits added the ability to specify default repositories and credentials for resolving dependencies at launch. They also fixed minor issues and added support for kernel info requests. These changes enhanced the kernel's ability to manage and resolve dependencies for different environments.
incubatingapachebig-dataapache-sparkjava
conda/conda-lock
Sep 2019 - Jan 2023
Lightweight lockfile for conda environments
Contributions:29 releases, 106 reviews, 398 commits in 3 years 5 months
mambacondalockfileenvironments
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.