We actually could see Romeny win a majority of the votes but actually lose the election through the electoral college. If that were the case Romney's people might really have a hard time with it.
In the case of Bush/Gore is was a very slim margin .05% but if Romeny win's by 4-6% but loses you will see a real issue being brought up and even more polarization taking place in the country.