It's fascinating to watch, in real time, the catastrophe which sunk Atlantis. Everyone's just fighting over who's biases to use, rather than re-examining the systems that have been created which demand a bias in the first place.
Between this high-profile disaster and character.ai's suicide lawsuit (which I've talked about here), it feels more and more and more like the current system's gonna end up getting torn to shreds once this bubble bursts.
I thought "character.ai's suicide lawsuit" was your way of describing a stupid lawsuit that is suicidal to the company, but this is so much fucking darker, god.
Looking back at my quick-and-dirty thoughts about the suit, I feel like I handled it in a pretty detached way, focusing very little on the severe human cost that kicked off the suit and more on what it could entail for AI at large.
I'm relatively confident that AI represents the formalization of the perspective adhered to by those who run the economy. So, yes, once AI finally fails spectacularly that will serve as the death knell for their entire system. Many probably already know it, which is why things are falling apart left and right, but that bubble bursting will be the end of their last ditch effort.
Honestly, I think it's less sinister, and more that they legitimately believed that was how the human mind actually worked, so "copying" that blueprint with machines was supposed to result in a reasonable facsimile of a human. Because of the failure, they have to rethink their entire strategy right from the start, which means our entire economic and political system needs to be reimagined.