Importance-Aware Data Selection for Efficient LLM Instruction Tuning
Scaling Up Dataset Distillation to ImageNet-1K with Constant Memory
Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspective
Training-Inference Mismatch In LLM KD(II)
FROM CORRECTION TO MASTERY: REINFORCED DISTILLATION OF LARGE LANGUAGE MODEL AGENTS
Merge-of-Thought Distillation
Delta Knowledge Distillation for Large Language Models
Massive Activations in Large Language Models
TD3: Tucker Decomposition Based Dataset Distillation Method for Sequential Recommendation
Dataset Condensation for Recommendation