I don't know why you're getting upset about it. The focus of the conversation was completely different to the point you made, so you can see why it was open to misinterpretation. If it's models rather than young women it's a totally different comment.
Don't you think it's a bit weird that he's only ever dated women 25 or under?
My general experience is women of the age he dates are often very insecure, and that makes its way into the bedroom, so whatever beauty bonus that comes with dating young supermodels is instantly negated by that. A decade later and they might look worse by modern beauty standards but the confidence and self awareness they have makes it far a better experience for both. And that's if we're keeping it to the superficial, physical level.
I say this as someone who recently had a fling with a 23 year old, so I'm not coming it at from some kind of supposed moral highground. But she did feel very young, in more ways than one, and on some level I found it a little...I dunno, off-putting? And I'm only 28. If I wanted to do that when I'm in my 50s, I'd find it a little tragic.