It's also possible that a large number of white males just... didn't think Mitt Romney was a good candidate, so they stayed home.

Complain about McCain all you want, but he was a Military Veteran and a Senator for decades, with a real track record of integrity. He beat Romney last election cycle, and apparently for a good reason, he ended up carrying more votes.