Is it better to check if a file exists before trying to load it, or to try to load it, and catch the error and move on?

You should do both. Creation and catching of exceptions can be an expensive process and even if the check for the file succeeds the loading of the file may not in which case you'll need to handle the exceptions anyway.