Self-Distillation | Bingbing Wenhttps://bbwen.github.io/tags/self-distillation/Self-DistillationHugo Blox Builder (https://hugoblox.com)en-usTue, 01 Sep 2026 00:00:00 +0000https://bbwen.github.io/media/icon_hu_982c5d63a71b2961.pngSelf-Distillationhttps://bbwen.github.io/tags/self-distillation/STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimeshttps://bbwen.github.io/publications/stop-structured-on-policy-pruning/Tue, 01 Sep 2026 00:00:00 +0000https://bbwen.github.io/publications/stop-structured-on-policy-pruning/<p>STOP uses a model&rsquo;s own reasoning traces to create more efficient fine-tuning examples. It segments and annotates each trace, builds a reasoning tree, and retains the prefix ending at the earliest correct answering conclusion. This removes unnecessary reasoning after a solution while preserving a coherent path to the answer.</p>