Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment
Paper
•
2601.14249
•
Published
•
9
[papers] Distillation
-
-
Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
Paper • 2402.07033 • Published • 19 -
MeepleLM: A Virtual Playtester Simulating Diverse Subjective Experiences
Paper • 2601.07251 • Published • 11 -
GameTalk: Training LLMs for Strategic Conversation
Paper • 2601.16276 • Published • 12 -
Self-Distillation Enables Continual Learning
Paper • 2601.19897 • Published • 24 -
Reinforcement Learning via Self-Distillation
Paper • 2601.20802 • Published • 35 -
Cache What Lasts: Token Retention for Memory-Bounded KV Cache in LLMs
Paper • 2512.03324 • Published • 1 -
Self-Improving Pretraining: using post-trained models to pretrain better models
Paper • 2601.21343 • Published • 14 -
Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Models
Paper • 2601.18734 • Published • 2 -
FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale
Paper • 2601.22146 • Published • 8 -
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 139 -
DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs
Paper • 2503.07067 • Published • 32