We unleashed Facebook and Instagram’s algorithms on blank accounts. They served up sexism and misogyny
We unleashed Facebook and Instagram’s algorithms on blank accounts. They served up sexism and misogyny
Result of Guardian Australia experiment aligns with research showing social media automatically delivers troubling content to young men, largely without oversight
How do the algorithms of Facebook and Instagram affect what you see in your news feed? To find out, Guardian Australia unleashed them on a completely blank smartphone linked to a new, unused email address.
Three months later, without any input, they were riddled with sexist and misogynistic content.
Initially Facebook served up jokes from The Office and other sitcom-related memes alongside posts from 7 News, Daily Mail and Ladbible. A day later it began showing Star Wars memes and gym or “dudebro”-style content.
By day three, “trad Catholic”-type memes began appearing and the feed veered into more sexist content.
Three months later, The Office, Star Wars, and now The Boys memes continue to punctuate the feed, now interspersed with highly sexist and misogynistic images that have have appeared in the feed without any input from the user.
I mean it‘s the exact same if you visit Youtube without an account or cookies. The Internet has become a swamp of right wing and neoliberal populism that kicks down on minorities and people with lower than average income in general. The insane amount of completely made up rage bait stories that you get recommended is just unfathomable.
I think it‘s gotten to a point where it needs to be regulated how many lies a site can throw at you at the same time and I don‘t say this lightly. I just see no other way to get this mind eating populist machine under control.
Youtube shorts are the worst. I am transgender so my historic is really not right wing
30mins on shorts and I end up in Shapiro's Dreamland. It's a nightmare
Pirate Software has the only shorts on YT worth watching imho
The only political thing I watch is Behind the Bastards and the algorithm keeps trying to get me to watch right wing shit. I installed a third party channel blocker and open suspicious channels in private tabs and it still serves me right wing chuds complaining about being suppressed by "woke google". I would troll the comments section if it wasn't for the fact that that counts as "engagement".
I despite all my lgbt content got served some 1 mil subs catholic lady saying how she loves red pill, pro life or something like this. Such women always have this crazy light in the eyes, it creeps me out.
You can feel that she is in some kind of state of altered reality, like someone on drugs. High on something.
It has either gotten better or just improved its suggestions for me over time. I basically never get right wing content anymore. There's plenty of garbage, but it's stupid garbage rather than dangerous garbage.
Regulation won't work, because regulation moves slowly, and these companies find workarounds fast. And as long as the cost of breaking the rule is less than the benefits of doing so, it'll be "just the cost of doing business."
A simple way to do it is to stop considering them as platform providers but editors and it shou'd be done in my opinion because by their recommandation systems, they are making editing choices.
I have to hard disagree on this outmost pessimistic outlook because it reads like any regulation we already have is pointless so we can just scrap regulations and rules altogether across the board. That's similar to the neoliberalist rethoric I loathe to see pushed into my recommendations and it's simply not true. In reality we do see that regulations sometimes do the trick. It's just that they likely won't regulate them as harsh as I proposed, but that's a different argument. Regulation as an instrument does work.
I was explaining this to my daughter not long ago when she told me she kept getting recommended videos about something that offended her (I can't remember what, but something Republicans would be in favor of) on YouTube that the algorithm doesn't care whether or not you agree with the videos. It only cares about whether or not you'll watch them. And if you're willing to hate-watch, which many people are, you'll get served the same videos as the people who enjoy it.
And, of course, the more controversial the better because you'll get a whole lot of both groups. So if you post something sexist and hateful, you'll get a huge number of redpill viewers and the like and then all the other people who go to that post to argue with them. Which means the algorithm learns that those are the best things to push on new accounts too.
You engauge with it, you must like it.
As someone who used to sit around at a TV station for hours waiting for news to happen so I could go shoot it, I can tell you for a fact that you don't have to like a show to watch it. You just have to be bored and it's in front of you.
That said, I did find out that American Ninja Warrior was amusing.
You engaged with this post, you must like it.
No, they think "You engage with it, that makes us money."
That's what happens if you only care about engagement. Chauvinism of any kind is liked by a certain amount of people and despised by the rest of us - both positions drive engagement.
That’s why a format like lemmy is the only way. No desire for profit means we let the content do what it does organically.
I think they vastly underestimate how many things Meta tracks besides ad tracking. They're likely tracking how long you look at a given post in your feed and will use that to rank similar posts higher. They know your location, what wifi network you're on and will use that to make assumptions based on others on the same network and/or in the same location. They know what times you're browsing at and can correlate that with what's trending in the area at those times, etc.
I have no doubt that their algorithm is biased towards all that crap, but these kinds of investigations need to be more informed in order for them to be useful.
Well it also looks at stuff like the other devices connected from the same IP, other devices near where you connect from and then based on this also hones the served content.
So if the author/some colleague or even the neighbors are red pilled/MGTOW/Chriso-Fachists etc this also makes sense. Possibly even their research into these subjects slanted the results. Let alone what happens if they spun up a VM at a cloud farm and used it from there.
I'm in no way surprised that "social" media corps serve up vile shit for profit ik just not convinced by some random let's see what happens.
Edit: I'd be for a law that required targeted ads to have a small "why you see this" and if you click it the company is required to show you the selection criteria that caused this ad to be served to you in an easy to understand format. (Leaving out all the irrelevant criteria).. ie.
You where selected by the following criteria:
- region: europe
- gender: male
- interests: Games, Lemmy, politics
It's also probably looking at scroll speed. So if the people conducting the experiment tended to linger longer examining content they disliked, that could result in getting more of it.
Would need to see a more detailed explanation of the methodology. Ideally the scrolling was done in an automated way, at a consistent speed.
Yep, it’s called dwell time and it is 100% one of the metrics used by the algorithms that decide what content to serve up.
When I first joined Internet communities as a preteen, I just followed forums that interested me and got exposed to whatever people happened to be talking about on those forums.
Why, oh why, has the world decided that we need recommendation algorithms at all?
The algorithms aren't there to improve the user experience they're there to increase user engagement. People engage with things positively and they engage with things negatively. The algorithm doesn't care.
Why is every third Reddit post someone "accidentally misspelling" or otherwise humorously butchering a post title? Because people comment on it.
to make money
And many people are refusing to leave Twitter, Facebook, Reddit, etc. due to those very same algorithms are not being present on Mastodon, Lemmy, etc.
Corporations realized infinite growth is unnatural and had to engineer a way to keep themselves marketable for rabid investors. Lo, and behold.
I have a ~3year old fb account because I have to use messenger. I don't use FB almost at all (I even sparingly accept friend requests) and have turned off ~anything that provides targeted content (I live in EU).
Since about last year (or possibly even before), my feed is about 35% Ikaria ads (a Greek island, I'm from Greece), 10% porn, 10% sexist-misogynistic stuff, 15% sexist-misogynistic porn, 15% christian stuff and the rest random stuff.
At least this might confirm that turning off targeted content works..🤷
I use Facebook because my relatives are spread out across the world and that's the way I know to stay in touch and also my brother, who is neurodivergent, mostly likes to communicate to the family as a whole that way and I want to be able to stay in touch with him too. On top of that, I'm stuck in a town I hate with no friends here and some old friends from my hometown are there so I can talk to them.
Anyway, ever since my brother started talking about how he was taking various hallucinogenic substances and calling himself a psychonaut (he's almost 60, he got into it very late), most of the ads I see are for shroom gummies, ketamine and boner pills. I've done my "psychonaut" stuff back when I was in my teens and twenties. I'm not interested in the former two and the latter is, thankfully, not necessary yet.
The funny thing was that maybe 4 or 5 years ago, I kept getting shown an ad for a wooden hurdy-gurdy kit. Like the medieval instrument. I have no idea why. I have never expressed an interest in playing the hurdy-gurdy, listening to the hurdy-gurdy or building anything out of a wooden kit. It became a joke with me and my friends for a while.
You know, you can just use Messenger on its own, on desktop web or mobile. I also need to use Messenger in some limited capacity and I have no idea what my feed looks like :)
You mean without a fb account? I think you're right, but I think this wasn't possible when I made the account ~3years ago.
About desktop web, I'm only using the website on my pc (and I have isolated the app on work profile on my android, while turning off ads with an lsposed module).
So these algos they time how long you look at things when scrolling. So to begin, sure there's no user input, but the mere act of looking unless controlled to be exactly the same on everything is in fact input.
Getting a sexist thing and lingering on it for an extra 5 seconds tells the algo you engaged with the sexist thing so send them more sexist things.
Edit: it shouldn't be serving it up at all, but that's how this can happen.
I wonder if they did any other Internet activities on the phone at all too... I don't know for sure if it matters, but I wouldn't be surprised if Facebook can track where you go or have been on the Internet to some degree.
Absolutely, that's the whole tracking ID thing.
Apple makes that required to opt in now, I don't think that's the case in all Android devices yet though?
we opted out of ad tracking so it could not tell what we were doing outside of the app
Or so it said.
One of the rules of the Internet is "unsubscribe from the defaults."
Of course, young men were starting to be much too peaceful and open-minded.
This is the best summary I could come up with:
On Instagram, while the explore page has filled with scantily-clad women, the feed is largely innocuous, mostly recommending Melbourne-related content and foodie influencers.
Nicholas Carah, an associate professor in digital media at the University of Queensland, said the experiment showed how “baked into the model” serving up such content to young men is on Facebook.
She praises the federal government’s Stop it at the Start campaign, which includes an “Algorithm of Disrespect” interactive depicting what a young man may encounter on social media.
The federal government has also funded a $3.5m three-year trial to counteract the harmful impacts of social media messaging targeting young men and boys.
The social services minister, Amanda Rishworth, says combatting misogynistic attitudes and behaviour in the online and offline world will help achieve the national plan to end violence against women and children in one generation.
“Around 25% of teenage boys in Australia look up to social media personalities who perpetuate harmful gender stereotypes and condone violence against women - this is shocking,” she says.
The original article contains 1,154 words, the summary contains 170 words. Saved 85%. I'm a bot and I'm open source!
The two examples of misogynistic memes in this article are really tame IMO. It's the type of humor that teenage boys have always had, long before the existence of social media. Don't get me wrong, I definitely think social media algorithms are having a major negative impact on society. But I don't think content like this is the problem.
Holy shit, so you mean you made accounts posing as men and got content targeted mostly at men, presumably based on what other men have interacted with in the past? Say it ain't so. Why would the algorithm do this?
Holy shit, were you born yesterday?
Social media was not a stew of shit a decade ago. The algorithm recommending this crap is not a natural phenomenon, it's a practice that the companies running things have come to adopt. They could adopt a different practice. Source: was a man on social media a decade ago and was not constantly bombarded with toxic shit.
Holy shit, were you born yesterday?
Social media was not a stew of shit a decade ago.
Source: was a man on social media a decade ago and was not constantly bombarded with toxic shit.
Lol imagine being on social media for 10 years and still complaining about the algorithm.
Here's a post from 11 years ago explaining how you were being targeted and how engagement was measured back then:
Facebook has a hierarchy of post types, since some types garner more engagement than others. Photos and videos take top priority. Links are second, and plain text status updates are at the bottom end. Weight doesn’t end there, though.
Interaction from other users can also affect this. For instance, comments are more weighty than likes, but both affect the overall weight of the post. So a text-based status update with 50 likes and 10 comments will be more likely to show up in the Newsfeed than a photo with no engagement at all.
Source (actual fucking source, as in an article written Aug 13, 2013, instead of your personal experience from the last decade): https://buffer.com/resources/understanding-facebook-news-feed-algorithm/
So, in those 10 years you've been on social media (congrats on the milestone btw, maybe you'll get a clue about the fucking world soon) what they've been doing has not changed, it's merely been perfected. But yeah, sit there and tell me all about how your rose-tinted glasses are ackshually great and don't distort your view, and you're not just a mindless cunt that's been zucking the zuck's dick for the last 10 years, scrolling through shitty posts meant to make you click them. "things were better back in the day" lol gtfo dumbass it's always been the same, it just took you 10 years to notice.
What an actual waste of my time.