Study of 8k Posts Suggests 40+% of Facebook Posts are AI-Generated
Study of 8k Posts Suggests 40+% of Facebook Posts are AI-Generated
Have you seen a Facebook post and wondered if it was AI-generated or human-written? In this study, we analyze the impact of ChatGPT and generative AI tools on Facebook posts. These are our findings.
Originality.AI looked at 8,885 long Facebook posts made over the past six years.
Key Findings
- 41.18% of current Facebook long-form posts are Likely AI, as of November 2024.
- Between 2023 and November 2024, the average percentage of monthly AI posts on Facebook was 24.05%.
- This reflects a 4.3x increase in monthly AI Facebook content since the launch of ChatGPT. In comparison, the monthly average was 5.34% from 2018 to 2022.
You're viewing a single thread.
how tf did it take 6 years to analyze 8000 posts
I pretty sure they selected posts from a 6 year period, not that they spent six years on the analysis.
I can’t even fathom how they would go about testing if it’s an AI or not. I can’t imagine that’s an exact science either.
In that case, how/why did they only choose 8000 posts over 6 years? Facebook probably gets more than 8000 new posts per second.
Every study uses sampling. They don't have the resources to check everything. I have to imagine it took a lot of work to verify conclusively whether something was or was not generated. It's a much larger sample size than a lot of studies.
I have to imagine it took a lot of work to verify conclusively whether something was or was not generated
The study is by a company that creates software to detect AI content, so it's literally their whole job
(it also means there's a conflict of interest, since they want to show how much content their detector can detect)
It’s a much larger sample size than a lot of studies.
It's an extremely small proportion of the total number of Facebook posts though. Nowhere near enough for statistical significance.
It's an extremely small proportion of the total number of Facebook posts though. Nowhere near enough for statistical significance.
The proportion of the total population size is almost irrelevant when you use random sampling. It doesn't rely on examining a large portion of the population, but rather that it becomes increasingly unlikely for the sample set to deviate dramatically from the population size as the number of samples rises. This is a function of the number of samples you take, decoupled from the population size.
https://en.wikipedia.org/wiki/Sampling_(statistics)
Usually if you see a major poll in a population, it'll be something like 1k to 2k people who get polled, regardless of the population size.