共计 34 篇文章
2026
OPD_SNR
Data_Parallel
Model_Parallel
ZeRO
Connections Between On Policy Distillation And RL
2025
Distilling the Essence: Efficient Reasoning Distillation via Sequence Truncation
Instruction tuning with loss over instructions
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
RETAINING BY DOING: THE ROLE OF ON-POLICY DATA IN MITIGATING FORGETTING
Different Designs For LLM KD Loss(II)