It doesn't require moderator intervention. Moderators do not even have access to vote information from what I know, they inform the team who investigate it
If someone has down voted you a bunch of times, a task runs every once and a whole by the system that will fix your reputation, and penalize the voter. This is known as "serial downvoting."
Basically, the system takes care of this, not moderators