Break the quadratic wall of Transformer attention: WERSA, paper+code open source(huggingface.co)

3 pointsby insert_nickقبل 12 شهرًا1 comments

Break the quadratic wall of Transformer attention: WERSA, paper+code open source

https://huggingface.co/vincenzodentamaro/wersa

1 comments

mdanielقبل 12 شهرًا

I'm not deep enough in the ecosystem to ingest that paper but it's title reminded me of an interesting video I saw recently: "AI can't cross this line and we don't know why" https://youtube.com/watch?v=5eqRuVp65eY