Should we deactivate downvotes?

For some reason posts on our instance have recently gotten more downvotes from outside instances than usual and many posts look like this:

I personally don't like the idea of disabling downvotes but if the feature is mostly going to be used by outside users because crypto is "le bad" we might as well turn it off.