William Dreese
Data Engineer
New York, New York, United States
Summary
🤩
Rockstar🎓
Top SchoolWilliam Dreese is a Data Engineer with a decade of experience building high-scale backend systems, currently designing data pipelines, API services, and database solutions for Chartbeat in New York. He specializes in Python-driven, test-first engineering for real-time Kafka pipelines and terabyte-scale analytics on RDS and Snowflake, deployed on AWS. His background spans applied machine learning and distributed systems—from WAMI aerial surveillance at Logos to computer vision research at Western Digital and Penn State—giving him an uncommon blend of research experience and production rigor. An active open-source contributor, he has improved core functionality and fixed race conditions in high-performance Go columnar stores like kelindar/column. Comfortable navigating both low-latency streaming and large historical queries, he focuses on pragmatic, observable systems that power data products end-to-end.
9 years of coding experience
Bachelor of Science - BS, Computer Science, Bachelor of Science - BS, Computer Science at Penn State University
French
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (13)
bitmap10
bitmaps10
go10
column-store10
indexing10
concurrency9
data-structure9
data-structures9
testing8
datastore7
database7
storage7
databases7
Programming languages (3)
Github contributions (5)
kelindar/column
Mar 2022 - Dec 2022
High-performance, columnar, in-memory store with bitmap indexing in Go
Role in this project:
Back-end Developer
Back-end DeveloperContributions:3 reviews, 8 commits, 9 PRs in 9 months
Contributions summary:William primarily contributed to the core functionalities of a high-performance, columnar, in-memory store, as indicated by their changes. They focused on enhancing and adjusting code comments for better clarity and fixing issues related to indexing functions. The user also implemented new functionalities such as the `Sum` operation for numeric columns and introduced a sorted index. Additionally, they addressed and fixed race conditions within the code.
golangmemorybitmapsoacolumnar-storage
Dreeseaw/salmon
Feb 2022 - May 2022
an embedded, distributed cache built for maximizing data locality
Contributions:42 commits, 40 PRs, 91 pushes in 2 months
golangstream-processinglocalityrustgrpc
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.