Wei Liu
Software Engineer at Netflix
New York, New York, United States
Summary
🤩
Rockstar🎓
Top SchoolWei Liu is a software engineer with eight years of experience, currently building big-data compute and Spark-based streaming at Netflix in New York. He previously spent three years at Databricks working on Spark Structured Streaming and is an active Apache Spark open-source contributor. His contributions focus on test automation and hardening core structured streaming features — session windows, stateful operators, and query error handling — helping improve stability for one of the world’s most widely used analytics engines. He holds an MS in Computer Science from the University of Chicago and a BS in Mathematics & Computer Science from UIUC, with internships at Amazon and Facebook that deepened his systems experience. A less obvious strength is his minor in psychology, which he applies to design tests and debugging strategies that surface realistic failure modes and improve operator ergonomics.
8 years of coding experience
3 years of employment as a software developer
University of TokyoHigh School, High School at Beijing 101 Middle SchoolUniversity of Illinois Urbana-ChampaignMaster of Science - MS, Computer Science, Master of Science - MS, Computer Science at University of Chicago
Chinese, English, Japanese
Github Skills (12)
scala10
scala210
stream10
spark10
spark-structured-streaming10
streaming10
testing10
java9
javas9
data-engineering8
sql8
big-data7
Programming languages (6)
Github contributions (5)
apache/spark
Sep 2022 - Apr 2025
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer & Test Automation Engineer
Back-end Developer & Test Automation EngineerContributions:359 reviews, 152 PRs, 509 comments in 2 years 6 months
Contributions summary:Wei primarily focused on improving the testing infrastructure and implementing new tests within the Apache Spark codebase. Their contributions involved adding and enhancing test suites, specifically targeting functionality related to streaming session windows, stateful operators, and query execution errors. The user also addressed code quality issues and ensured compatibility by fixing typos and making code style improvements. The user's work directly supports the testing and stability of core structured streaming features.
analyticspythondata-processingsqlapache
WweiL/LeetCode
Jul 2018 - Jun 2021
Contributions:198 pushes, 1 branch in 2 years 11 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.