Let's wait and see before getting out the pitchforks. I'm sure he has info on his end like the voter's ip address. If he saw something like, on average, 5.5 votes per ip address, except for two addresses that voted thousands of times, it would be easy to cull the votes from those 2 addresses. That seems fair to me.
Edit: Reading through the comments, the site owner seems to say as much: