The first part of this article reminds me of something that was missing from the article a while back, on the flaws of LW/Rationalist style thinking. It was missing that LW/Rationalists love to create binary camps. Object vs Meta, Soldier vs Scout mindset, Founder vs Manager, and here external "AI is fake and sucks” internal "AI is real and dangerous.” camps. These mindsets are often massively flawed and lead to very simplistic thinking (see for example how in this case, the AI is real vs AI is fake actually removes 2 camps (the internal 'AI is fake' people and the external 'AI is real' people)).
Splitting but worse, because when attacked over this they can retreat to the castle which says 'no we don't mean these as strict camps, but as ranges, and one is not better than the other.
This is one of the superweapons Scott claimed feminism has. (Yeah, I'm part elephant, I still am going on about the now deleted meditations on superweapons).