I switched my home server from ARM SBCs to a $140 N100 (16GB) and honestly it's a real improvement.
I love the original concept of the SBCs --- affordable and efficient, with hardware acceleration for compute-heavy tasks. But the reality for me lately has just been more trouble than it's worth, and running a mainline kernel on x64 is such a better experience. (I'm mostly griping at the Orange Pi I had --- RPi tend to have better SW support.)
$20 more and it probably beats the snot out of the Pi performance wise and probably came in a case and with the power cables to run it...A Pi at $120 is lunacy.
I recently got a used custom Tiger Lake NUC and QuickSync does some heavy lifting for Jellyfin. Much better transcode performance than the dedicated AMD GPU I was using on an older system.