Jonathan Hung
Staff Software Engineer at The Apache Software Foundation
Mountain View, California, United States
Summary
🤩
Rockstar🎓
Top SchoolJonathan Hung is a Staff Software Engineer at LinkedIn in Mountain View with 10 years of experience building backend and distributed systems. He blends production engineering at scale with open-source leadership as an Apache Hadoop PMC and committer, contributing practical features such as a file-based CapacityScheduler configuration provider. His OSS work spans workflow and ML-on-Hadoop tooling—augmenting Azkaban to inject job-level configs and tags into YARN/MapReduce and improving TonY’s deployment, retry behavior, and TensorFlow environment handling. A Stanford MS/BS graduate, he’s known for shipping durable scheduler and workflow integrations that make complex Hadoop clusters easier to manage and operate.
10 years of coding experience
6 years of employment as a software developer
Stanford University
Github Skills (26)
hadoop-mapreduce10
cap10
yarnberry10
apache-hadoop10
testing10
configuration-management10
workflow-engine10
mapreduce10
hadoop10
java10
scheduler10
yarn-210
javas10
sched10
yarn310
Programming languages (4)
Github contributions (5)
tony-framework/TonY
Sep 2018 - Oct 2019
TonY is a framework to natively run deep learning frameworks on Apache Hadoop.
Role in this project:
Back-end Developer & DevOps Engineer
Back-end Developer & DevOps EngineerContributions:2 releases, 13 reviews, 31 commits in 1 year 1 month
Contributions summary:Jonathan primarily focused on modifying the TonY framework's core components to improve configuration and deployment on Hadoop. They refactored configuration file handling, introduced configurable retry mechanisms for resource managers, and implemented features for Azkaban integration. Additionally, the user addressed testing and added environment variables to ensure proper TensorFlow configuration within the framework.
horovoddeep-learningmachine-learningapachehadoop-yarn
apache/hadoop
Jan 2017 - Feb 2021
Apache Hadoop
Role in this project:Back-end Developer
Back-end DeveloperContributions:201 commits, 2 PRs, 1 comment in 4 years 1 month
Contributions summary:Jonathan contributed to the Apache Hadoop project by implementing features related to the CapacityScheduler, focusing on the use of a configuration store. The changes included adding a `CSConfigurationProvider` interface and a `FileBasedCSConfigurationProvider` implementation. These modifications allow the CapacityScheduler to load configurations from an external file, improving manageability and potentially enabling dynamic updates to the scheduler's behavior. Furthermore, the commits introduce changes to testing and web service configuration related to configuration management.
apachebig-datasparkhadoopjava
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.