Mansoor Shaik
Big Data Engineer
Cary, North Carolina, United States
Summary
👤
Senior🎓
Top SchoolMansoor Shaik is a Big Data Engineer with a decade of experience building cloud-native data platforms and MLOps pipelines, currently driving big data initiatives at Apple from Cary, NC. He has deep hands-on expertise in Kubernetes, Kubeflow Pipelines, Spark, and both AWS and Azure infrastructure, having moved PoCs to production-grade, stateless Kubeflow v1.4 deployments and authored Kubernetes CRDs in Go. Mansoor combines backend microservice development (FastAPI, Celery, RabbitMQ) with IaC and GitOps practices (Terraform, Terragrunt, ArgoCD, GitHub Actions) to automate and scale data workflows. He has contributed to the popular kubeflow/pipelines project, improving CLI UX and JSON outputs—an indicator of his focus on developer experience in ML platforms. Early career work in large Hadoop ecosystems and health-data analytics at IQVIA underpins his strong data engineering foundation. Known for bridging data science and platform engineering, he brings a pragmatic blend of automation, observability, and production readiness to complex ML deployments.
10 years of coding experience
6 years of employment as a software developer
Bachelor of Technology - BTech, Information Technology, 7.89, Bachelor of Technology - BTech, Information Technology, 7.89 at Gandhi Institute of Technology & Management (GITAM) University, VisakhapatnamMaster's degree, Computer and Information Systems Security/Information Assurance, 3.90, Master's degree, Computer and Information Systems Security/Information Assurance, 3.90 at Pace University
English, Telugu, Hindi
Stackoverflow
492reputation
37kreached
35answers
0questions
Github Skills (19)
python10
mlops10
kubeflow-pipelines10
cli10
kubernetes9
machine-learning9
kubernetes-pods9
json8
data-science8
apache-kafka6
pyspark6
dataframe6
scala6
apache-spark6
hadoop6
Programming languages (6)
Github contributions (5)
kubeflow/pipelines
Oct 2020 - Jan 2021
Machine Learning Pipelines for Kubeflow
Role in this project:
MLOps Engineer
MLOps EngineerContributions:19 reviews, 7 commits, 5 PRs in 3 months
Contributions summary:Mansoor primarily focused on enhancing the command-line interface (CLI) functionality of the Kubeflow Pipelines SDK. They added support for JSON output formatting, improved the display of pipeline and run information, and addressed missing short options for CLI commands. Furthermore, they modified the run and experiment CLI to improve user experience by incorporating click echo statements and correcting output messages. Their work streamlined the user experience for interacting with Kubeflow pipelines through the CLI.
pipelinetektondata-sciencemachine-learningmlops
arcizon/spark-filetransfer
Apr 2020 - Sep 2020
API for reading and writing data via various file transfer protocols from Apache Spark.
Contributions:11 releases, 36 commits, 3 PRs in 4 months
sparksqlapiapachesparkfile-transfer
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.