Ask HN: Could we build an open, decentralized version of GPT-3?3 ポイント·投稿者 HugThem·6 年前·1 コメントI find it somewhat scary, that the most advanced AI is only available to whoever gets selected by a single authority.From what I read, the model has 175B parameters and therefore cannot run on a normal computer.Could we build something like AI@Home where everyone contributes some memory/processor time?Getting up to some hundred GB of memory does not seem too hard this way.I guess the hard part is creating a decentralized NN. Not sure how much research has been done on this already.1 コメントコメントを投稿[–]grigoriperelman·6 年前返信the training part would be extremely difficult owing to the rapid-data transfer rates that are required. current p2p stac k would be a bad solution for that.
From what I read, the model has 175B parameters and therefore cannot run on a normal computer.
Could we build something like AI@Home where everyone contributes some memory/processor time?
Getting up to some hundred GB of memory does not seem too hard this way.
I guess the hard part is creating a decentralized NN. Not sure how much research has been done on this already.