Deepyaman Datta - Maintainer at Kedro

Deepyaman Datta

Maintainer at Kedro

Salt Lake City, Utah, United States

Join Prog.AI to see contacts

Summary

🤩

Rockstar

🎓

Top School

Deepyaman Datta is a seasoned backend and data engineer with a decade of experience building scalable data and ML infrastructure, currently maintaining Kedro and contributing across the Python data ecosystem. He has shipped production integrations and tooling—spanning stream and batch execution with Ibis/Flink, orchestration improvements for Dagster, and pipeline tooling at QuantumBlack/McKinsey—demonstrating both hands-on engineering and systems design. An active open-source contributor, Deepyaman has made substantive contributions to high-profile projects like Apache Spark, pandas, Koalas (pandas-on-Spark) and Ibis, often improving API parity, type inference, and testing across backends. He combines a strong academic foundation (Stanford CS, dual degrees from UT Austin) with experience accelerating cloud data processing at Schlumberger and improving observability and reliability in large-scale analytics. Notably, he pairs deep engineering rigor with product-facing sensibilities—optimizing data catalogs, dataset versioning, and developer UX to make complex pipelines more maintainable and composable.

10 years of coding experience

11 years of employment as a software developer

Bachelor of Science with Honors, Electrical and Computer Engineering, Bachelor of Science with Honors, Electrical and Computer Engineering at The University of Texas at Austin

Master's Degree, Computer Science, Master's Degree, Computer Science at Stanford University

Stackoverflow

Stats

538reputation

25kreached

19answers

12questions

Github Skills (63)

data-visualizations10

apache-spark10

spark10

data-pipelines10

python10

dagster10

data-science10

data-engineering10

testing10

dataframes10

pandas10

big-data10

pyspark10

data-visualisation10

workflow-engine10

Programming languages (16)

C#JavaC++RustScalaTeXVueGo

Github contributions (5)

kedro-org/kedro

Jul 2019 - Jan 2023

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

Role in this project:

Back-end Developer

Contributions:433 reviews, 116 commits, 242 PRs in 3 years 7 months

Contributions summary:Deepyaman contributed to the data science and data engineering aspects of the Kedro project, making changes related to data loading, saving, and pipeline modularity. They modified the handling of arguments for loading and saving datasets, introduced new dataset versions, and improved code related to the project's setup and contributions. The user also refactored code to replace older functionality, making it compatible with newer versions of supporting libraries.

experiment-trackingpythonsciencepipelinedata-science

kedro-org/kedro-viz

Feb 2022 - Oct 2022

Visualise your Kedro data and machine-learning pipelines and track your experiments.

Role in this project:

Back-end Developer & Data Scientist

Contributions:44 reviews, 5 commits, 24 PRs in 7 months

Contributions summary:Deepyaman contributed to improving the performance and functionality of the Kedro-Viz project. Their work included optimizing code related to data catalog handling and dataset retrieval, particularly when dealing with missing datasets. They also addressed issues related to docstrings and Behave step definitions, improving code quality and maintainability. Additionally, they made enhancements to the project's UI components and modular pipeline configurations, demonstrating full-stack understanding.

experiment-trackingpythonreactkedro-plugindata-science

Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.

Request Free Trial