I actually like the idea of being able to see how many upvotes/downvotes came from specific instances much more than seeing the actual users. It would cover some of the positives mentioned in the github discussion:

-Could help fight bot and multiple-account voting (if we assume that people who make multiple accounts do it on the same instance)
-Could help identify voting-patterns from specific servers (obviously)

And then if something looks suspicious, the admins can already see who voted, so they could check out whether some user is abusing the mechanics.

I find that this approach might be worth talking about, but making user votes visible to all seems very unnecessary.