LLMs having emergent abilities is an illusion driven by metrics selection [pdf](proceedings.neurips.cc)
proceedings.neurips.cc
LLMs having emergent abilities is an illusion driven by metrics selection [pdf]
https://proceedings.neurips.cc/paper_files/paper/2023/file/adc98a266f45005c403b8311ca7e8bd7-Paper-Conference.pdf
1 comments
Interesting analysis showing that the supposed emergent abilities with sharp changes in metrics when scaling LLMs are actually rather metric dependent and when you change to an actual linear metric, you also see linear progress.