LLaMA Pro: Progressive LLaMA with Block Expansion(arxiv.org)
arxiv.org
LLaMA Pro: Progressive LLaMA with Block Expansion
https://arxiv.org/abs/2401.02415
1 コメント
Appears to be a way to address catastrophic forgetting in LLMs
https://arxiv.org/abs/2401.02415