For whatever it may be worth, he was only ever married once (to Loretta Young's younger half-sister) - and it was for a whopping 63 years.

So if he was a ladies man, he concealed it well. Either that or his wife knew, they had an "understanding", and she chose to tolerate it.