Martin Durant
Staff Software Engineer at Anaconda, Inc.
Toronto, Ontario, Canada
Summary
🤩
Rockstar🎓
Top SchoolMartin Durant is a Staff Software Engineer with 12 years of experience who builds and maintains critical open-source Python data engineering tools from Toronto, Canada. Trained as an astrophysicist with a PhD from the University of Toronto, he brings rigorous scientific thinking to large-scale data problems and is the lead developer of widely used projects such as fsspec, s3fs, gcsfs, fastparquet and Intake, each with millions of downloads. At Anaconda he drives backend and I/O improvements across the PyData ecosystem, contributing significant Parquet, Dask, Zarr and streaming integrations that improve performance, reliability and cloud compatibility. His work spans low-level storage semantics to distributed actor patterns and real-time Kafka streams, reflecting deep expertise in filesystems, async I/O and distributed computation. Rare among engineers, he pairs academic research experience with product-facing impact—having also taught intensive Python courses and helped create the Anaconda Navigator UX.
12 years of coding experience
3 years of employment as a software developer
Master's degree, Physics, 1st class, Master's degree, Physics, 1st class at University of OxfordDoctor of Philosophy (Ph.D.), Astronomy and Astrophysics, Doctor of Philosophy (Ph.D.), Astronomy and Astrophysics at University of Toronto
Spanish, English, Hungarian, German
Stackoverflow
27,960reputation
1.8mreached
964answers
7questions
pandas
top-1%
dataframe
top-5%
pyspark
top-5%
parallel-processing
top-5%
pyqt
top-1%
python
top-1%
Github Skills (47)
asynchronous10
filesystem10
realtime10
pytest10
python10
async10
data-engineering10
testing10
pandas10
kafka10
asyncio10
distributed-computing10
google-cloud-storage10
gcp10
pyqt10
Programming languages (21)
Github contributions (5)
intake/intake
Jan 2018 - Jan 2023
Intake is a lightweight package for finding, investigating, loading and disseminating data.
Role in this project:
Back-end Developer
Back-end DeveloperContributions:75 reviews, 319 commits, 519 PRs in 5 years 1 month
Contributions summary:Martin contributed to the development of the `intake` library, focusing on extending its functionality with a new `tiled` source to access data from a Tiled server, integrating it into the existing catalog system. They added supporting code for the new source, including a TiledCatalog and TiledSource, and also included tests for the integration. Furthermore, the user fixed driver imports and adjusted testing configurations to improve functionality.
pythondata-sciencedata-accessfindingsinger
fsspec/filesystem_spec
Apr 2018 - Jan 2023
A specification that python filesystems should adhere to.
Role in this project:Backend Developer
Backend DeveloperContributions:438 reviews, 486 commits, 1225 PRs in 4 years 9 months
Contributions summary:Martin made several contributions to the `fsspec/filesystem_spec` repository, which defines a specification for Python filesystems. Their work focused on improving the documentation through the clarification of docstrings. They also implemented an assertion to verify that a loop was running within an asynchronous context. Further, the user updated existing code, including files related to callbacks, reference filesystems and file operations in http.
specificationfilesystemspythonfilesystem
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.