That's pretty much the conclusion: you should try uv first, and there's a small chance it doesn't work for you and you're not willing to fix it, or it's out of your hands.
Examples include legacy projects and companies that don't allow it (but I do question how they'd even enforce this, and how developers can even do their jobs if they can't run binaries at the user level).
It makes heavy use of caching and occasionally that goes wrong and give confusing errors until you think to uv clean
It's an extra step to install uv which you may not want to impose on users, or CI.
Astral might die.
But it's sooooo much better than the official tooling (and the competition like Poetry) that the conclusion is still the same: you should definitely use it.