Far from being an urban myth, it is a measurable reality.
I've been going to the gym since I was in my teens and once was running over 40km a week.
There is no way now I could ever lift as much weight, for as many repetitions, or run as fast as I could even 5 years ago.
Muscle size and firmness decreases significantly once over the age of 40.