Barbara Miller
Engineer at Internet Archive
Portland, Oregon, United States
Summary
🤩
RockstarBarbara Miller is an engineer based in Portland, Oregon with 11 years of hands-on experience building and maintaining large-scale web archiving systems. At the Internet Archive she leads technical work on Archive-It and Python Wayback, contributing across Python, JavaScript, Java, Ansible, Hadoop and UNIX tooling to capture, replay, index and manage multi‑terabyte web archives. A versatile full‑stack developer and quick learner, she has shipped crawler improvements and video capture fixes in notable open-source projects like Brozzler and Heritrix, including AMQP integrations and site-specific browser behaviors. Comfortable in remote and international teams, she pairs systems-level ops skills (Linux, OpenStack, AWS) with recent data-science and modern-language study (Go, Rust, Jupyter), and enjoys translating complex archival requirements into practical, automatable solutions.
11 years of coding experience
French, Czech, English
Github Skills (24)
wayback-machine10
javascript10
yt-dlp10
character-encoding10
web-crawler10
webscraper10
python10
testing10
ytdl10
webscraping10
java10
crawling10
browser-automation10
javas10
heritrix10
Programming languages (8)
Github contributions (5)
internetarchive/brozzler
May 2016 - Oct 2022
brozzler - distributed browser-based web crawler
Role in this project:
Full-stack Developer
Full-stack DeveloperContributions:48 reviews, 717 commits, 192 PRs in 6 years 6 months
Contributions summary:Barbara made various contributions to the `brozzler` repository, including browser-related configurations, behavior implementations for specific websites, and updates to the core crawling logic. The user added features for handling user logins, implemented JavaScript behavior for Instagram, and adjusted the browser's network settings. Furthermore, the user addressed issues related to video downloads and made changes to the project's documentation.
browserweb-crawlerweb-basedcrawlingcrawler
internetarchive/heritrix3
Jun 2016 - May 2022
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
Role in this project:Back-end Developer
Back-end DeveloperContributions:1 review, 71 commits, 39 PRs in 5 years 11 months
Contributions summary:Barbara primarily contributed to the Heritrix3 web crawler project by implementing features related to AMQP integration, specifically around queuing and processing URLs received via AMQP. They developed components like `AMQPUrlWaiter` and `AMQPUrlReceiver` to manage the flow of URLs. The user also worked on `ExtractorYoutubeDL`, configuring the tool to extract video metadata, and applying filters. These changes show an understanding of the crawler's architecture and its interaction with external systems.
web-crawlerinternet-archivescalearchivecommoncrawl
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.