How annoying is it to connect to VPN/use Tailscale instead of being able to access the service directly?

So I'm just being introduced to the concept of using a VPN or something like Tailscale to access one's services, instead of opening the services directly to the web, but I'm thinking for streaming purposes or just accessing your services on the run, isn't it an annoyance having to connect to your home network all the time? Or do you keep the VPN running on your phone for example? What if you use a VPN provider for privacy purposes, wouldn't one need to then switch VPN connection?