What if I tell the model to go commit fraud or crimes and it complies? What if users are having psychotic episodes driven by their interactions with the model?
Just because safety is a hard and messy problem doesn't mean we should just wash our hands of it.
Usually all code has an owner though. If I encounter a bug the first thing I often do is look at git blame and see who wrote the code then ask them for help.
Most people are far more concerned about their livelihood than about abstract notions of beating China in a game of geopolitics. In that scenario the US becomes an isolated economy, and other nations likely follow suit. It will be a poorer, less dynamic world, but most people will choose that outcome over poverty.
If the worst predictions about AI's effect on employment turn out to be correct, then I'd expect to see movements to force government regulation of AI. Particularly if it becomes the case that profits are accruing to a few massive corporations who run the AI.
There is no reason people have to tolerate a technology that is destructive to society, anymore than they have to tolerate companies selling fentanyl at 7/11.
I have mixed feelings. On the one hand, I totally feel what this author is saying. On the other hand , I love that I am now able to push into areas that I could have never touched before, and complete successful projects in them.
I created this Claude plugin that allows you to set a target for the percentage of human generate code in your project, and when you are below that target it hard blocks Claude from writing code.
Like many people, I am simultaneously excited about the power that AI gives me, and also fearful of what will happen if I give up coding altogether, both to my competence and to my personal satisfaction. I find that using this plugin allows me to set a balance that falls between pure vibe coding and writing everything by hand.
If this resonates with you, I hope you find some use from this plugin.