Principal Engineer at The Apache Software Foundation
Berkeley, California, United States
Join Prog.AI to see contacts
Join Prog.AI to see contacts
Summary
🤩
Rockstar
🎓
Top School
Julien Le Dem is a Principal Engineer based in Berkeley with 15+ years designing and shipping large-scale data systems and open source infrastructure. He co-created OpenLineage and helped found Parquet and Arrow, contributing deep protocol and format work spanning Parquet, Arrow, Iceberg and Marquez that power modern analytics pipelines. A consensus-driven technical leader and mentor, he excels at clarifying architecture, producing high-quality code, and giving constructive, detail-oriented reviews that help teams move faster. Julien blends hands-on back-end and systems-level craftsmanship (format specs, IPC schemas, encoding optimizations) with community leadership as an Apache PMC member and project chair. He favors pragmatic, peer-oriented collaboration and has a track record of turning research ideas (Dremel-inspired columnar storage) into widely adopted production standards.
15 years of coding experience
24 years of employment as a software developer
Mathematics Physics, Mathematics Physics at CPGE Pierre Corneille Rouen
Lycee les Fontenelles, Louviers
MSc / diplome d'ingénieur Computer Science, MSc / diplome d'ingénieur Computer Science at Institut Supérieur d'Informatique Modélisation et leurs Applications
Contributions:15 reviews, 85 commits, 7 PRs in 7 years 1 month
Contributions summary:Julien primarily contributed to the Apache Parquet format definition files. Their work involved modifying the Thrift IDL files, adding new data types, and refactoring the dictionary encoding. They improved the metadata handling, added statistics, and implemented a new data page type. Additionally, the user added a utility class to hide Thrift and updated the changelog, demonstrating a strong understanding of the Parquet file format's internal structure and its evolution.
Contributions:5 reviews, 11 PRs, 3 pushes in 9 years 9 months
Contributions summary:Julien's commits primarily focus on refactoring code to use indices instead of field names, streamlining the process of reading and writing data within the Parquet format. They further enhanced the data storage by integrating support for decimal values with the aid of the existing Binary object, while also integrating new values to the page level encoding. The user also addressed bugs associated with handling empty fields.
avroparquetapachebig-dataapache-parquet
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Julien Le Dem - Principal Engineer at The Apache Software Foundation