Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
Role in this project:
ML Engineer Contributions:29 reviews, 30 PRs, 13 pushes in 5 months
Contributions summary:Sean made several contributions related to training and generation within the Dolly large language model project. They modified training parameters, specifically increasing evaluation steps. The user also added and updated NVIDIA library installations, and optimized model generation for specific hardware (A10, V100). Finally, they refactored the code to leverage the Hugging Face dataset and correctly set flags for bf16 training on specified hardware.
chatbotdatabricksdollygpt
Code to accompany Advanced Analytics with Spark from O'Reilly Media
Role in this project:
Data Scientist Contributions:5 releases, 4 reviews, 193 commits in 7 years 11 months
Contributions summary:Sean primarily contributed to the implementation of clustering algorithms, specifically focusing on K-means and its variations. Their contributions included initial K-means code, along with iterations exploring scoring methods and normalization techniques. They also developed code to visualize the clustering results using R and incorporated categorical features. Furthermore, they implemented an anomaly detection system and a decision forest model, demonstrating a focus on applying machine learning techniques.
analyticso-reillyspark