Fine-Tuning TranslateGemma-4B for Better Welsh Translations on an H200 GPU
A guide details fine-tuning TranslateGemma-4B for Welsh on a single NVIDIA H200 GPU to improve translation while preserving instruction-following capability.
- TranslateGemma inherits multimodal processor expectations from the PaliGemma lineage, requiring the pillow library even in a text-focused workflow.
- The training loop uses completion-only loss to keep optimization pressure on the model's answer instead of penalizing it for prompt tokens.