Jay is an Engineering Director with a decade of experience building scalable big-data platforms and real-time trading data products, currently leading CeFi Trading Data at OKX from Hangzhou. He combines PhD-level research in large-scale graph and time-series processing with hands-on delivery at ByteDance and DBS, turning complex 5V data challenges into production-ready pipelines. Deep expertise in Java, Spark (SQL, Streaming, GraphX), Kafka, HBase and containerization is paired with a knack for platformizing data engineering workflows to accelerate team adoption of big-data stacks. An active contributor to major open-source projects (including fixes to Ray’s data processing/webdataset and SQL read paths), he brings both algorithmic rigor and pragmatic engineering. Notably, he has repeatedly moved academic-scale distributed systems concepts into enterprise services that serve millions of users.
10 years of coding experience
7 years of employment as a software developer
Doctor of Philosophy (PhD) Computer Science, Doctor of Philosophy (PhD) Computer Science at National University of Singapore
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Role in this project:
Data Engineer & Backend Developer
Contributions:15 reviews, 32 PRs, 81 comments in 7 months
Contributions summary:Jay primarily contributed to the data processing and manipulation aspects of the Ray project. They focused on improving the webdataset functionality, including fixing errors, flattening return arguments, and expanding JSON objects. Additionally, the user addressed issues related to the data handling, specifically fixing a groupby hang when values contained `np.nan`. They also contributed to SQL read functionality.
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Contributions:1 PR, 219 pushes, 28 branches in 6 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.