There's a script that runs every night (UTC) that should revert all those downvotes. There will be no other consequences for you.
The user who serially downvoted you, however, might get a friendly reminder from us not to do it again.
(Then again, this is your Stack Overflow account, not your Super User one, so you'd have to have a Stack Overflow mod check it out… not sure why you posted this on SU in the first place. Your question should have been posted on Meta Stack Overflow, just so you know for the future.)
