Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
Role in this project:
Back-end Developer Contributions:17 commits, 26 PRs, 139 comments in 6 months
Contributions summary:Paul contributed significantly to Dr. Elephant's back-end functionality, focusing on improving the system's robustness and expanding its capabilities. Their work included enhancing the resource manager selection process for Hadoop and Spark, adding support for the Airflow scheduler, and configuring parameters for Spark logging. Moreover, the user made performance improvements by refactoring code and fixing bugs in the flow and job history pages. These changes improved Dr. Elephant's capabilities and maintainability.
apache-hadoopapache-sparkperformance-monitoring
Contributions:36 commits, 2 pushes in 1 year 5 months