They think the women are lying.
It's very much a male mindset. Sometimes some women do lie. But this doesn't sound like that sort of case.
To me, it looks a lot more like a story of a guy who was occasionally a nasty and aggressive drunk when he was younger and either has forgotten it, or is too stubborn to admit it.
Hence he doesn't want an investigation.
He can do a lot of good by stepping aside. But he doesn't seem to have the wisdom to seek the greater good at his own expense.