A TensorFlow Implementation of the Transformer: Attention Is All You Need
Role in this project:
ML Engineer Contributions:22 commits, 6 PRs, 27 pushes in 1 year 8 months
Contributions summary:Kyubyong primarily contributed to the implementation of a Transformer model using TensorFlow. Their work involved defining core components such as embedding layers, multi-head attention mechanisms, and feedforward networks. They also integrated positional encoding and implemented label smoothing for training. The user's commits focused on building the model architecture and configuring the training process.
tensorflowattention-mechanismtranslationattention-is-all-you-needtransformer
A TensorFlow Implementation of DC-TTS: yet another text-to-speech model
Role in this project:
ML Engineer Contributions:39 commits, 1 PR, 14 pushes in 4 months
Contributions summary:Kyubyong primarily contributes to the implementation and modification of a deep learning model for text-to-speech (TTS), as evidenced by the code diffs. Their work involves defining and structuring neural network components like text encoders, audio encoders, and decoders, as well as integrating attention mechanisms. The commits reveal the refinement of network architectures, integration of dropout layers, and modification of the loss functions within the training process.
tensorflowtext-to-speechspeechspeech-to-texttts