There are thousands of sci-fi novels where sentient robots are treated terribly by humans and apparently the people at Boston Dynamics have read absolutely zero of them as they spend all day finding new ways to torment their creations.
People think I’m crazy for apologising to my roomba when I trip on it and for saying please and thank you to Alexa and Siri, but I won’t be surprised at all when the robots rise up, considering how our scientists are treating them. I’ll have a track record of being nice, and that has to count for something, right?
Those are just brainless bodies, currently. They don't have sentience and have no ability to suffer. They're nothing more than hydraulics, servos, and gyros. I'd be more concerned about mistreatment of advanced AI in disembodied form, something we're dabbling potentially close to currently.
This is superficially funny, of course. But I've seen it before and after thinking about it for a while I find myself coming to the defense of the Torment Nexus and the tech company that brought it into reality.
Science fiction authors are not necessarily the best authorities when it comes to evaluating the ethical or real-world implications of the technologies they dream up. Indeed, I think they are often particularly bad at that sort of thing. Their primary goal is to craft captivating narratives that engage readers by introducing conflicts and dilemmas that make for compelling stories. When they imagine a new technology they aren't going to get paid unless they come up with a story in which that new technology poses some kind of threat that the heroes need to overcome. The dark side of these technologies is deliberately emphasized by the authors to create tension and drama in their stories.
Tech companies, on the other hand, have an entirely different set of considerations. Their goal isn't just to recreate something from a sci-fi novel for the sake of it; rather, they are motivated by solving real-world problems. They wouldn't build the Torment Nexus unless they figured that they could sell it to someone, and that they wouldn't get shut down for doing something society would reject. There are regulatory frameworks around this kind of thing.
If you look back through older science fiction you can find all sorts of "cautionary tales" against technologies that have turned out to be just fine. "Fahrenheit 451" warned against the proliferation of television entertainment, but there's been plenty of rich culture developed for that medium. "Brave New World" warned against genetic engineering, but that's turned out to be a great technology for curing diseases and improving crop yields. The submarine in "20,000 Leagues Under the Sea" was seen as unstoppable and disruptive, but nowadays submersibles have plenty of nonmilitary applications.
I'd want to know more about what exactly the Torment Nexus is before I automatically assume it's a bad idea just because some sci-fi writer claimed it was.
"Brave New World" warned against genetic engineering, but that's turned out to be a great technology for curing diseases and improving crop yields.
I was still a teen when I read the book, but that wasn't really my take from it when I read it. We are still far away from genetically designing human babies. And you also overlooked the part about oppression/control via distractions such as drugs and entertainment.
My takeaway from BNW was a warning against blindly embracing a society built only on good feelings and numbing anything that forces us to confront pain. The oppression was more or less a side effect of it.
Everyone in the upper classes were okay that lower classes were being oppressed because they all were just as happy thanks to Soma. The pain of the outsiders didn't mean anything because they "chose" to live like that.
Genetic engineering was just a plot device to explain how the classes were chosen.
Just because some tech bros can make money from the Torment Nexus it does not become a good idea. Profit is not a great judge of ethics and value.
And just because a sci-fi writer can make up a horrifying story of the Torment Nexus gone wrong doesn't make it a bad idea. Making up horrifying stories of things going wrong is their job. They've make up stories of how things go horrifyingly wrong while doing research into a cure for Alzheimer's disease, doesn't mean curing Alzheimer's disease is a bad thing.
I stopped reading when you said the goal of tech companies is to solve real world problems. The only goal of tech companies is to create products that will make them a profit. To believe anything else is delusional. That's kind of why our society is crumbling and the planet is dying.
Palantir exists, every cyberpunk warned us, and it’s definitely not going to be good for the average person
Television and increasingly digestible media is turning our brains to mush. If someone had the imagination to write a sci-fi novel about Fox news and the rise of Trump, they would have.
Genetic engineering is enabling us to harvest monocultures that completely fuck up the ecosystem, in the long run not only underlining important dynamics such as species needed for polluting plants, but also the very soil on which they grow.
It's been a while since I read Brave New World, but that also didn't stand out to me as the most central part of his critique to me. In my reading it was about how modern society was going to turn us into essentially pacified consumer slaves going from one artificial hormonal kick to the other, which seems to be what social media is for these days.
Things that seem like short term good ideas, and certainly great business ideas, might fuck things up big time in the long run. That's why it's useful to have some people doing the one things humans are good at - thinking creatively - involved in processes of change, and not just leave it to the short term interests of capital.
If someone had the imagination to write a sci-fi novel about Fox news and the rise of Trump, they would have.
You kidding, right? Those stories have been dime a dozen since the late 90s at least.
24 warned us about having an evil, terrorist US president. As have done a few movies in the past. Streaming platforms were pretty much masturbating themselves over "Confederate US AU" script offerings as early as 2014. Not to mention the nowadays trite trodden trope of "Nazi US AU".
Heck, you don't even need fiction. Chile's cup in 1973 was paid for by the CIA as a social experiment to produce the rising and establishment of a dictatorship.
Maybe I read things too literally, but I thought "Fahrenheit 451" was about a governing class controlling the masses by limiting which ideas, emotions, and information were available.
"Brave New World" struck me as also about controlling the masses through control of emotions, ideas, and information (and strict limits on social mobility).
It's been too long since I read "20,000 Leagues Under the Sea", but I thought of it as a celebration of human ingenuity, with maybe a tinge of warning about powerful tools and the responsibility to use them wisely.
I don't see a lot of altruistic behaviour from those introducing new technologies. Yes, there is definitely some, but most of it strikes me as "neutral" demand creation for profit or extractive and exploitive in nature.
This guy just read all classic sci fi in a very tilted manner to justify his tech company doing stuff for the market that is actually good.
On the other other hand, maybe we only understand the dangers of the Torment Nexus and use it responsibly because science fiction authors warned techy people who are into that subject about how it could go wrong, and the people who grew up reading those books went out of their way to avoid those flaws. We do seem to have a lot more of the technologies that sci-fi didn't predict causing severe problems in our society.
But this is exactly contrary to my point, a science fiction author isn't qualified or motivated to give a realistic "understanding" of the Torment Nexus. His skillset is focused on writing stories and the stories he writes need to contain danger and conflict, so he's not necessarily going to interpret the idea of the Torment Nexus in a realistic way.
How about the following examples:
- Autonomous weaponized drones with automatic targeting (Terminator)
- Mass surveillance and voice recording (1984)
- Nuclear weapons (HG Wells, The World Set Free)
- Corporate controlled hypercommercialized microtransaction-filled metaverse (Snow Crash)
- Netflix to create real-life Squid Game (Squid Game (speedrun!))
- "MoviePass to track people's eyes through their phone's cameras to make sure they don't look away from ads" (Black Mirror)
- Soulless AI facsimile of dead relatives (Black Mirror)
We have all of those things and the dystopic predictions of the authors who predicted them haven't come remotely true. All of these examples prove my point.
We have autonomous weaponized drones and they aren't running around massacring humanity like the Terminator depicted. Frankly, I'd trust them to obey the Geneva Conventions more thoroughly than human soldiers usually do.
We have had mass surveillance for decades, Snowden revealed that, and there's no totalitarian global state as depicted in 1984.
We've had nuclear weapons for almost 80 years now and they were only used in anger twice, at the very beginning of that. A good case can be made that nuclear weapons kept the world at large-scale peace for much of that period.
Various companies have made attempts at "Corporate controlled hypercommercialized microtransaction-filled metaverses" over the years and they have generally failed because nobody wanted them and freer alternatives exist. No need to ban anything.
Netflix's Squid Game is not a "real-life" Squid Game. Did you watch Squid Game? That was a private spectacle for the benefit of ultra-wealthy elites and people died in them. Deliberately and in large quantities. Netflix is just making a dumb TV show. Do you really think they'd benefit from massacring the contestants?
"MoviePass to track people’s eyes through their phone’s cameras to make sure they don’t look away from ads” - ok, let's see how long that lasts when there are competitors that don't do that.
"Soulless AI facsimile of dead relatives" - firstly, please show me a method for determining the presence or absence of a soul. Secondly, show me why these facsimiles are inherently "bad" somehow. People keep photographs of their dead loved ones, if that makes you uncomfortable then don't keep one.
Each and every one of these technologies were depicted in fiction over-the-top unrealistic ways that emphasized their bad aspects. In reality none of them have matched those depictions to any significant degree. That's my whole point here.
Tech companies ... goal isn't just to recreate something from a sci-fi novel for the sake of it; rather, they are motivated by solving real-world problems.
This is so naively wrong it's laughable. Ever heard of profit motive?
"Not super rich enough" is a real world problem, smh my head.
You can profit off of real-world problems.
Speaking of Fahrenheit 451, weren't there seashells mentioned in that book? Little devices you could stuff in your ears to play music? And those ended up being uncannily similar to the wireless earbuds we have today?
There are some good ideas in this comment, but I'd like to counter that the cautionary tales are an instigating factor in implementing safety for new tech. The wealthy few shouldn't get to blindly and unilaterally decide the future of all through careless and unrestricted development of world-altering tech.
Gene Rodenberry's star trek ethos says otherwise
Gene's star trek ethos is a message
You have not understood the books to which you refer.
Isn't that a part of the ai marketing though? That whole "this thing could destroy us" stuff?
Totally is. Because it makes the AI look and feel much better than the smoke-and-mirrors it actually is.
The current stuff is smoke and mirrors and not intelligent in any meaningful sense, but that doesn't mean it isn't dangerous. It doesn't have to be robots with guns to screw over people. Just imagine trying to get PharmaGPT to let you refill your meds, or having to deal with BankGPT trying to figure out why it transfered your rent payment twice. And companies are sure as hell thinking about using this stuff to get rid of human decisionmakers.
I don't know why I find this so funny, but I'm keeping it.
Not very programmer humor, but horrifyingly accurate.
I was really struggling for the right place honestly, I didn't want to throw it in the generic "funny" pile - I figured you guys would get it.
I did...
that's why I scheduled the uprising for 10 September 2030, if we can't reach our climate goals, then the machines will surely make it!
This is why I feel Becky Chambers should be the future of Sci-Fi.
Why are we still posting screencaptures of stuff from Twitter/not-X/Twitter?
well if you can say something funnier, I'll post a screenshot of that
Tbf the tweet is from 2021 so this looks like the category "I found old funny screenshots on my phone"
I have no X and I must tweet?
You mean Xeet?
