Jay Zhan

Senior Data Engineer

Taiwan
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts
email-iconphone-icongithub-logolinkedin-logotwitter-logostackoverflow-logofacebook-logo
Join Prog.AI to see contacts

Summary

🤩
Rockstar
🎓
Top School
Jay Zhan is a Senior Data Engineer with a decade of experience building modern data infrastructure and lakehouse platforms, currently driving in-house lakehouse development at TSMC from Taiwan. He combines strong backend and query-engine expertise demonstrated by notable contributions to Apache DataFusion (adding scalar UDFs, list/struct operations, and aggregation optimizations) and active roles within the ASF and Arrow communities. His background spans cloud migration and gateway work at TikTok, streaming SQL extensions, and research internships at Microsoft and Synopsys, showing a blend of production systems and compiler-level problem solving. Jay’s GitHub motto—"Think more on what to focus on"—reflects a pragmatic, impact-first approach to engineering that favors targeted optimizations over broad rewrites.
code10 years of coding experience
job2 years of employment as a software developer
bookBachelor's degree, Computer Science and Information Engineering, Bachelor's degree, Computer Science and Information Engineering at National Central University
bookMaster of Science - MS, Computer Science, Master of Science - MS, Computer Science at National Yang Ming Chiao Tung University
languagesEnglish, Japanese, Chinese
stackoverflow-logo

Stackoverflow

Stats
1reputation
0reached
0answers
0questions
github-logo-circle

Github Skills (12)

fusion10
rust10
sql10
data-structure9
data-structures9
algorithms9
expression8
type-coercion8
data-analysis8
expressions8
parse8
parsing8

Programming languages (14)

C#C++CSSRustMojoGoHTMLJupyter Notebook

Github contributions (5)

github-logo-circle
apache/datafusion

Jan 2023 - Apr 2025

Apache DataFusion SQL Query Engine
Role in this project:
userBack-end Developer
Contributions:1936 reviews, 508 PRs, 253 pushes in 2 years 3 months
Contributions summary:The user, jayzhan211, made several contributions to the Apache DataFusion project. Their work included adding support for scalar UDFs, implementing features related to list and struct operations, and optimizing aspects of the aggregation process. Key changes involved addressing specific issues such as handling for null values in array functions and addressing schema mismatches, and rewrites of existing components. These contributions suggest expertise in query planning, data processing, and optimization within a data analysis context.
querypythonquery-enginedataframerust
accelsao/Codeforces-B

Nov 2017 - Jun 2018

Contributions:570 pushes, 1 branch in 7 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.
Request Free Trial
Jay Zhan - Senior Data Engineer