Yeah, this isn't true. Young men are called "jeune homme" in cafés and such.

And then when you get older there comes a time when you're called "jeune homme" again, in a weird sarcastic-but-kind way. You will hear very old men be called "jeune homme" all the time, and then everyone laughs. Apparently it's a joke that never gets old.

(Source: am French).