AWS Tests GPT-OSS-20B Fine-Tuning for Multilingual Reasoning on SageMaker HyperPod

AWS authors fine-tuned GPT-OSS-20B on Amazon SageMaker HyperPod and reported improved adherence to requested languages in a 50-case multilingual evaluation. Supervised fine-tuning (SFT) increased reasoning-language compliance from 22 percent to 100 percent, while the subsequent group relative policy optimization (GRPO) stage raised answer-language compliance from 62 percent to 70 percent. These measures concern the language used in reasoning and answers, rather than answer accuracy. In a separate control experiment using Qwen2.5-7B-Instruct, the authors reported additional multilingual gains but no improvement on GSM8K. They used that result to support their guidance to apply GRPO where there is room for improvement.

Generated by AI from reports · Updated 43 minutes ago

There is not enough continuous observation data to plot a trend yet.