I fully agree with this perspective.

Downvoting is redundant with a report feature. Removing downvotes is less comparable to platforms like Youtube, since this place is actually moderated.

People use it primarily as an "I don't like this" button, when they really should be ignoring it or filtering it out. It encourages people to engage with content they don't like. It gives trolls something to feed off of (any attention is good to them). It encourages hive mind behavior, less people thinking for themselves.

Don't give people tools that can be easily abused and expect them to be responsible with it. Give them tools that are easy to use correctly.