A toolkit for reproducible reinforcement learning research.
Role in this project:
Backend Developer Contributions:3 reviews, 20 commits, 28 PRs in 3 months
Contributions summary:Eric primarily contributed to the backend of the `garage` repository, specifically focusing on refactoring and improving existing algorithms. They removed an iteration variable from the `optimize_policy` method within several algorithm implementations like `TD3`, `DDPG`, and `SAC`, likely improving code clarity and potentially performance. They also implemented changes to support Pybullet environments, including adding and adapting `BulletEnv`. Further contributions included code updates to incorporate `TimeStepBatch` and `EnvStep` as well as modifying existing functionality related to the environment class to align with best practices.
reinforcement-learningrl-algorithmsreproducibilitypytorchtensorflow
Tiny Differentiable Simulator is a header-only C++ and CUDA physics library for reinforcement learning and robotics with zero dependencies.
Role in this project:
Backend Developer Contributions:11 commits, 7 PRs, 4 comments in 1 month
Contributions summary:Eric added core functionality related to a differentiable physics simulator. Contributions include implementing a SimpleRobot class, a COMVelocityEstimator, and an OpenloopGaitGenerator, which suggests the development of kinematic and dynamic control elements. Further work focused on integrating these components within a simulation environment using header-only C++ and CUDA, indicating a focus on performance and numerical computation. Additional commits added features related to a swing controller, further enhancing the robot's control capabilities.
cppcudareinforcement-learningroboticszero-dependencies