LLMs having capabilities they were not trained for – explained(assemblyai.com)

2 pointsby SleekEaglevor 3 Jahren1 comments

LLMs having capabilities they were not trained for – explained

https://www.assemblyai.com/blog/emergent-abilities-of-large-language-models/

1 comments

"After crossing an apparent critical value (between 1010 and 1011 effective parameters), the model seems to be catapulted into a new regime in which it can complete this (fairly complicated) task with drastically increased accuracy."

"The important part about this phenomenon is that we, a priori, do not know that this will happen in advance or even at what scale it might happen. "