Xingdong Zuo is a Research Engineer at NAVER Corp with 10 years of experience building scalable reinforcement learning and recommender systems that optimize long-term user engagement. He combines production-focused engineering—deploying retrieval, reranking, and autobidding models at million-user scale—with cutting-edge research in offline RL, having co-authored a NeurIPS 2023 paper and prototyped RLHF solutions. His contributions to widely used open-source tools like OpenAI Gym show practical full-stack skills in RL environments and augmentations (e.g., FrameStack, GrayScaleObservation). Beyond online services, he explores physical AI and learning-based robotic manipulation, reflecting a rare cross-domain interest in both digital decision systems and real-world adaptation.
10 years of coding experience
Master of Science - MS, Machine Learning, Master of Science - MS, Machine Learning at The University of Freiburg
Bachelor of Science (B.S.), Applied Mathematics, Bachelor of Science (B.S.), Applied Mathematics at Linnaeus University
A toolkit for developing and comparing reinforcement learning algorithms.
Role in this project:
Full-stack Developer
Contributions:52 commits, 63 PRs, 90 comments in 3 years
Contributions summary:Xingdong primarily contributed to the `gym` project, a toolkit for reinforcement learning. Their work included modifications to existing environment files, specifically updating and deleting files related to spaces and core functionalities. Furthermore, the user integrated a variety of wrappers, including new features like `GrayScaleObservation`, `ClipAction`, and `FrameStack`, which indicates a focus on enhancing the toolkit's capabilities. The user also updated documentation and other supporting files, indicating a well-rounded approach to the project.
Contributions:3 releases, 5 commits, 7 pushes in 7 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.