Composing the Idea: Why "Next Word Prediction" Misses the Point(medium.com)
medium.com
Composing the Idea: Why "Next Word Prediction" Misses the Point
https://medium.com/@peter_9588/composing-the-idea-why-next-word-prediction-misses-the-point-81eea25813f9
1 comments
There’s no sense of the pain or grief or joy (etc) the evolutionary magnetism that revolves around short wave ripples (memories) and torsional coherence cycles (focus) that crafts innovation from the tinkering of evolution (and hence imaginative, non linear creativity). Nothing in the musical existence prior to Charley Patton could invent his off beat mistiming, funky error ridden choruses, refrains, breaks because they sounded alien, strange, discordant, etc. And we know this from studying how long it took for Patton to reach T-Bone to the Everly Bros where it finally re-emerged in Richards. none of this leading edge is available to AI, and it shows in the slop I study coming out of these models. There’s nothing here but maladaption.