Strictly, there has to be at least as many people willing to punish than there are people unwilling to punish amongst the people the fraudster targets for the fraudster to lose all the gains from their scam. I don't know that this radically changes anything, but it's not quite the same thing as honest people outnumbering fraudsters.