Let's start with the obvious - you will be banned from review audits if you get too many - here's the official SE staffer post on the subjectofficial SE staffer post on the subject - it says the ban is up to a week, and the comments to this questionthe comments to this question state this is a temporary ban of up to 30 days.
On the other hand, review audits aren't designed to punish people with good intentions - they're designed to solve what many folk (myself included), consider a problem that's more prevalent on some of the other sites - people robo-reviewing for badges.
If it's occasional, chances are you won't get the proverbial rap to the knuckles. This is designed to prevent industrial scale misclicking.