OpenAI’s board, paraphrased: ‘All we need is unimaginable sums of money’(daringfireball.net)
daringfireball.net
OpenAI’s board, paraphrased: ‘All we need is unimaginable sums of money’
https://daringfireball.net/2024/12/openai_unimaginable
313 comments
OpenAI's engineers: brilliant, A+, A* even.
OpenAI's C-suite: Well, they earned the C, but it was a letter grade.
What a profoundly unimaginative strategy. No matter the industry, a large-scale diversion of resources towards a moonshot goal will likely get you to that goal. They haven't made an argument as to why we should do that just for them, especially with all of the other alternatives.
And no, advertising your previously secret testing models (e.g. o3) as if they were market competitors is not how to prove they should have our money.
OpenAI's C-suite: Well, they earned the C, but it was a letter grade.
What a profoundly unimaginative strategy. No matter the industry, a large-scale diversion of resources towards a moonshot goal will likely get you to that goal. They haven't made an argument as to why we should do that just for them, especially with all of the other alternatives.
And no, advertising your previously secret testing models (e.g. o3) as if they were market competitors is not how to prove they should have our money.
Unimaginable Sums of Money Are All You Need
The Unreasonable Effectiveness of Huge Sums of Money in the Natural Sciences
Unimaginable Sums of Money Considered Harmful
The Unreasonable Effectiveness of Huge Sums of Money in the Natural Sciences
Unimaginable Sums of Money Considered Harmful
In all fairness regarding his comment about Netscape - anyone who invested in Netscape at the IPO (and certainly before the IPO) at $2.9B - made a ton of money on the Internet. On the last day of trading, after the AOL exit 4 years it was worth (cash, stock, etc...) around $10B. Thank Mike Homer for pushing that one through, and Jim Barksdale for being savvy enough to recognize it as the right play.
This is why I don't think LLMs will lead anywhere other than the present: they are very expensive. If top LLM company in the world can't bring those costs down in a sensible amount of time, it tells you everything you need to know about the future of LLMs. Rest assured, once OpenAI goes down and it really sounds like they are way past the peak, valuations for other LLMs companies will follow. And once they can't raise funding, all of them aside from those backed by big conglomerates (see Google's Gemini and Facebook's Llama) will survive.
The long term future of LLMs sure looks like the LLMs themselves will be commodities and the real value will lie in the use of those LLMs to deliver value
The long term future of LLMs sure looks like the LLMs themselves will be commodities and the real value will lie in the use of those LLMs to deliver value
People keep saying stuff like this, but I don't believe it: "There is no technical moat in this field, and so OpenAI is the epicenter of an investment bubble."
AI progress is driven by strong valuable data. Detailed important conversation with a chatbot are much more valuable that quick search queries. As LLMs extend past web UIs, there is even more interaction data to capture and learn from.
The company that captures the most human-AI interaction data will have a TREMENDOUS moat.
AI progress is driven by strong valuable data. Detailed important conversation with a chatbot are much more valuable that quick search queries. As LLMs extend past web UIs, there is even more interaction data to capture and learn from.
The company that captures the most human-AI interaction data will have a TREMENDOUS moat.
Investors observed the pattern that the largest platform eats the market and bet on openAI moving along the same paths.
I disagree, that phenomenon is tied to the social network like phenomena we saw with WhatsApp and Facebook and to the aggregator business model of Amazon and Google.
Mathematically we can describe the process by which these monopolies form as nodes joining graphs:
Each node selects graphs to connect to in such a way that the probability is proportional to the number of nodes in the graph.
Sure Amazon and google feature two types of nodes, but the observation still fits: Selling on Amazon makes sense if there are many customers, buying on Amazon makes sense if there are many offers.
OpenAIs business does not have this feature, it does not get intrinsically get more attractive by having more users.
I disagree, that phenomenon is tied to the social network like phenomena we saw with WhatsApp and Facebook and to the aggregator business model of Amazon and Google.
Mathematically we can describe the process by which these monopolies form as nodes joining graphs:
Each node selects graphs to connect to in such a way that the probability is proportional to the number of nodes in the graph.
Sure Amazon and google feature two types of nodes, but the observation still fits: Selling on Amazon makes sense if there are many customers, buying on Amazon makes sense if there are many offers.
OpenAIs business does not have this feature, it does not get intrinsically get more attractive by having more users.
>> OpenAI currently offers, by far, the best product experience of any AI chatbot assistant.
Claude is noticeably better
Claude is noticeably better
I once had a colleague that told me in order to make a small fortune, all you need to do is begin with a large fortune.
Unimaginable sums of money can only come from oil rich countries. They are probably just mentally trying to accept that they are going to take the money from these nations.
The word "open" is still under threat in this scenario too.
The word "open" is still under threat in this scenario too.
A perfect fit for Softbank. I do not understand why a 'dream deal' between them has not happened yet?
I think their vision is as it should be ambitious, but I don't believe they can gain any real technical moat.
Models are commodities, even in the case Open ai goes through another major breakthrough nothing can stop some of their employees to run to other companies or founding their own and replicating or bettering the OpenAI results.
In fairness I realize that I don't use any of OpenAI's models. There are better alternatives for coding, translating or alternatives that are simply faster or cheaper (Gemini) or more open.
Models are commodities, even in the case Open ai goes through another major breakthrough nothing can stop some of their employees to run to other companies or founding their own and replicating or bettering the OpenAI results.
In fairness I realize that I don't use any of OpenAI's models. There are better alternatives for coding, translating or alternatives that are simply faster or cheaper (Gemini) or more open.
Where is all the money going? Nvidia hardware?
> defensible moat … investors mistakenly thought investing in Netscape was a good way to bet on the future
Yet Chrome for Google did help create a moat.
A moat that’s is so strong the DoJ is investigating if Chrome should be a forced divesture from Google/Aplhabet.
Note: I do generally agree with the article, but this also shows why you shouldn’t use analogies to reason.
Yet Chrome for Google did help create a moat.
A moat that’s is so strong the DoJ is investigating if Chrome should be a forced divesture from Google/Aplhabet.
Note: I do generally agree with the article, but this also shows why you shouldn’t use analogies to reason.
Plot twist: OpenAI uses their GPU farms to mine cryptocurrency so that they get those unimaginable sums of money
> There is no technical moat in this field
This is getting so repetitive now that it is stated as a truism.
Isn't it the same bet yahoo was betting on in 2000 that it would win because their product branding is better? And now, Yahoo's and Microsoft's search engine is worse than Google from 2 decades ago.
This is getting so repetitive now that it is stated as a truism.
Isn't it the same bet yahoo was betting on in 2000 that it would win because their product branding is better? And now, Yahoo's and Microsoft's search engine is worse than Google from 2 decades ago.
How do they define success after we gave them all the capital they're requesting?
Frankly, OpenAI efforts seem quite funny for me personally as for most tasks I do Claude is far superior and yet OpenAI behaves as if they were the only game in town.
The so-called open source models are getting better and better and even if OpenAI suddenly discovered some new tech that would allow for another breakthrough, it will be immediately picked up by others.
The so-called open source models are getting better and better and even if OpenAI suddenly discovered some new tech that would allow for another breakthrough, it will be immediately picked up by others.
[deleted]
This doesn't seem to say much to back its comparisons. Wouldn't spending a giant amount of money create some sort of moat?
I see some people talking about OpenAI "stealing" IP from the nonprofit side, but remember that they went "capped profit" back in 2019. It's possible that GPT-3 and later were developed entirely by the capped-profit side anyway. I doubt there's much if any pre-2019 IP left.
The paraphrasing is very comical, but a bit different from what they actually said, which is more like "more than we had imagined".
Gruber's shilling some here. Andreesen et al. started over from scratch when they created Netscape. They didn't use any of the NCSA code. It was a ground up re-write.
SamA wants to take everything the non-profit built and use it directly in HIS for profit enterprise. Fuck him.
SamA wants to take everything the non-profit built and use it directly in HIS for profit enterprise. Fuck him.
Why Meta decided to open source their Llama architecture and complete models?
From a strategic business perspective, I'm trying to puzzle why they would give that up, a competitive advantage (even though it might not be as good as OpenAI product), rather than directly competing with OpenAI. What's the reasoning behind this decision?
So tired of people asking for giant piles of money that are high enough to corner a market.
Same
AI going down the Cold Fusion path ? Not much of a surprise to me
Don't we all?
Don't we all...
Correction: all they need to succeed is unimaginable sums of money and the ironclad right to assimilate every work ever created by humanity without compensation. Who could refuse such a modest request?
https://www.theguardian.com/technology/2024/jan/08/ai-tools-...
https://www.theguardian.com/technology/2024/jan/08/ai-tools-...
> There is no technical moat in this field, and so OpenAI is the epicenter of an investment bubble. Thus, effectively, OpenAI is to this decade’s generative-AI revolution what Netscape was to the 1990s’ internet revolution. The revolution is real, but it’s ultimately going to be a commodity technology layer, not the foundation of a defensible proprietary moat. In 1995 investors mistakenly thought investing in Netscape was a way to bet on the future of the open internet and the World Wide Web in particular.
OpenAI has a short-ish window of opportunity to figure out how to build a moat.
"Trying to spend more" is not a moat, because the largest US and Chinese tech companies can always outspend OpenAI.
The clock is ticking.