Deletion Tuning

Deletion Tuning: Post-Training LLMs by Zeroing Just 0.05% of Weights

Deletion Tuning matches full-finetuning results by zeroing under 0.05% of weights, reducing forgetting and model size.