Jing Zhan is a software engineer based in the Greater Seattle Area with two years of professional experience focused on large-scale data processing and streaming systems. Currently at Databricks, Jing contributes to Spark Structured Streaming and has made notable open-source contributions to Apache Spark, including state management API enhancements, MapState implementation, and timer integration for streaming operators. Prior internships at Meta and Cyclone Robotics and a course assistant role at UIUC reflect a strong foundation in systems engineering and teaching. Trained in Mathematics and Computer Science at the University of Illinois Urbana-Champaign, Jing blends rigorous academic training with hands-on backend development in one of the most widely used big-data engines.
2 years of coding experience
1 year of employment as a software developer
Bachelor's degree, Mathematics and Computer Science, Bachelor's degree, Mathematics and Computer Science at University of Illinois Urbana-Champaign
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Contributions:256 reviews, 70 PRs, 264 comments in 1 year 3 months
Contributions summary:Jing primarily contributed to the Apache Spark project by implementing and testing new features related to the state management API. Their work involved adding checks for stateful operator changes in streaming applications, enabling serialization for case classes/primitives/POJOs using SQL encoders for the Arbitrary State API v2, and adding a MapState implementation. They also integrated range scan encoder changes with the timer implementation and provided support for initial state handling and timer integration. Furthermore, this user worked on adding support for reading transformWithState map state variables with state data source reader and providing support to use timer in transformWithStateInPandas API and initial state handing.
Apache Spark - A unified analytics engine for large-scale data processing
Contributions:4 PRs, 454 pushes, 71 branches in 1 year 2 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.