Yandex YaLM 100B: Largest GPT-Like Neural Network in Open Source(medium.com)
medium.com
Yandex YaLM 100B: Largest GPT-Like Neural Network in Open Source
https://medium.com/yandex/yandex-publishes-yalm-100b-its-the-largest-gpt-like-neural-network-in-open-source-d1df53d0e9a6
3 comments
What's the next big thing in the field?
Previous discussion: https://news.ycombinator.com/item?id=31846593 (642 comments)
[deleted]
Since then, around 70,000 new Transformer models have been released via HF.
There are several models much larger than YaLM, including BigScience BLOOM 176B and Tsinghua GLM-130B.
https://lifearchitect.ai/timeline/
https://lifearchitect.ai/models/