That assumes that AI needs to be like life, though.
Consider computers: there's no selection pressure for an ordinary computer to be self-reproducing, or to shock you when you reach for the off button, because it's just a tool. An AI could also be just a tool that you fire up, get its answer, and then shut down.
It's true that if some mutation were to create an AI with a survival instinct, and that AI were to get loose, then it would "win" (unless people used tool-AIs to defeat it). But that's not quite the same as saying that AIs would, by default, converge to having a drive for self preservation.
For some reason, the embedded videos seem to break in Firefox Private Browsing (128esr). This had me stumped for a while until I tried it in a normal not-private window and it worked.
I would put it like this: consistent small gains programming is about gluing components together. There are plenty of non-incremental (big impact or flop) programs that couldn't have been made by just gluing components together. E.g. BitTorrent, AlphaZero, and seL4.
> Outside transparency is not a benefit. Most people I've talked to about crypto don't see the opacity as a detriment. They do not trust the government or tax policy.
I think his point is: Bitcoin explicitly takes a libertarian position to taxation by making it hard to tax. While most crypto adopters may be libertarian, the majority of people are not and so the libertarian position will deter adoption.
The other side of that coin is, obviously, coiners who deduce that anyone opposing Bitcoin must be angry about being poor.
It's possible to dislike Bitcoin for its waste of its energy, centralization one step removed or economic policy without being "the guy who bought at the top".
Consider computers: there's no selection pressure for an ordinary computer to be self-reproducing, or to shock you when you reach for the off button, because it's just a tool. An AI could also be just a tool that you fire up, get its answer, and then shut down.
It's true that if some mutation were to create an AI with a survival instinct, and that AI were to get loose, then it would "win" (unless people used tool-AIs to defeat it). But that's not quite the same as saying that AIs would, by default, converge to having a drive for self preservation.