Arthur Wiedmer
Engineering Manager, Growth Data
San Jose, California, United States
Summary
🤩
Rockstar🎓
Top SchoolArthur Wiedmer is an engineering manager and growth data leader with 11 years of hands-on experience building scalable Big Data infrastructure and data tools at Netflix, Apple, and Airbnb. He combines a strong academic background in environmental engineering and spatial statistics with practical mastery of Spark, SQL, Airflow, and the Hadoop ecosystem to turn messy, heterogeneous data into reliable pipelines and models. Known for increasing data team productivity, he has contributed to core Apache Airflow features (including Presto and S3 integrations) and routinely modernizes legacy codebases to rigorous standards. Arthur’s work spans production data engineering, mentoring, and tooling—bridging research-grade analysis from his PhD work with production-scale engineering. Based in San Jose, he brings a pragmatic focus on data validation, observability, and simple, useful frameworks that scale. Outside of product teams, he retains a niche expertise in environmental and spatial modeling that informs his thoughtful approach to noisy real-world data.
11 years of coding experience
17 years of employment as a software developer
M.S./Ph.D. ABD Environmental Engineering, M.S./Ph.D. ABD Environmental Engineering at University of California, BerkeleyCollège Fénelon Ste-MarieBachelor of Science (B.S.) Engineering Science Mathematics Biomathematics, Bachelor of Science (B.S.) Engineering Science Mathematics Biomathematics at École PolytechniqueBaccalauréat Série Scientifique, Baccalauréat Série Scientifique at Lycée Louis-Le-Grand
English, French, German
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (15)
apache-airflow10
orchestration10
workflow-engine10
orchestra10
data-pipelines10
presto10
data-pipeline10
python10
data-engineering10
s3-bucket9
amazon-s39
sql9
aws-s39
hive9
boto8
Programming languages (5)
Github contributions (5)
apache/airflow
Jun 2015 - Aug 2018
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Role in this project:
Backend Developer & Data Engineer
Backend Developer & Data EngineerContributions:63 PRs, 64 pushes, 43 branches in 3 years 2 months
Contributions summary:Arthur contributed to the core functionality of the Apache Airflow project by implementing and modifying Presto-related operators and hooks. They added a PrestoCheckOperator and PrestoIntervalCheckOperator, enabling data validation and interval checks within the data pipelines. Moreover, the user enhanced the existing code base by adding new macros related to Hive partitions and modifying the logging levels and functions within the PrestoHook. Additionally, the user implemented an S3 hook and sensor to facilitate data transfer from S3.
monitorpythonschedulerapacheprogrammatically
ContinuumIO/airflow
Nov 2015 - Feb 2016
Airflow is a system to programmatically author, schedule and monitor data pipelines.
Contributions:16 commits in 3 months
monitorpythondata-sciencedata-pipelinesprogrammatically
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.