I've been using gocryptfs now for a few years and it works fine as you describe.
You initiate the encrypted folder, set up automatic backups for it. Then whenever you want to access it you mount it into another folder.
There is a distinction here between the permanently encrypted folder that you can upload backup whatever, and your temporary mount, unencrypted folder.
If you're alright with the rare conflicts to fix yourself something like syncthing works well for this setup even across computers.
Sorry I'm not sure I understand what it is you think I'm missing. It's FOSS, works on Linux, has a CLI, works for both files and directories... please enlighten me what I got wrong?