T5Gemma 2: The next generation of encoder-decoder models
T5Gemma 2 launches as the first multi-modal and long-context encoder-decoder models based on Gemma 3, featuring tied embeddings and merged attention mechanisms.
- The release explicitly states that no post-trained or instruction-tuned checkpoints will be made available to the public.
- Developers must perform their own supervised fine-tuning because the provided pre-trained checkpoints are designed specifically for post-training.