I think testosterone levels in cis men actually have been decreasing on average. I don't know how testosterone affects the aging process, so I can't speak on if the other person is being reasonable, though.
Also, last I checked the reason was still a mystery.
Lifestyle changes are one a reason. We used to be more active, and be out in the sun more which generates greater Vitamin D exposure. Having an indoor job, such as an office job, would definitely result in lower T levels without enough exercise and Vitamin D.
Another thing to consider is the abundance of microplastics. They are endocrine disruptors, and are shown to hurt T levels as well. Along with modern food processing ingredients like soy letchin showing to hurt testosterone levels, it really seems like we created this environment.
On another note, we know testosterone is intrinsically involved in voice maturity and facial hair, which partially leads me to believe it's responsible for more of your appearance.
Another forgotten factor is the higher amount of carb(even if the ratio of carbs vs. protein and fats are similar) has also contributed to lower T levels. Albeit not as dramatically, but every little factor is adding up. More T levels are not gonna hurt you(or reduce testicle size) if other biological systems and genetics can take in higher T levels.
Cancer rates in the US are up about 500% since 1970. My brother is in late 20s and is already needing testosterone meds, presumably due to years of work in industrial settings.
I just want to point out that we are better at detecting cancers now and we have a lot more information than in the 70s. So the 500% is still true, but a non negligeable part of that is that we are better at detecting it early.
I think cancer is going up due to all the unhealthy crap we are exposed to. We all have cancer cells in our body, but I believe that some things we consume may aggravate those cells. Like we don't eat as healthy as people once did.
Many of us consume fast food, soda, candy, and other junk more often than we should, and I think that constantly eating this processed food that we aren't really meant to eat could have this type of effect.
When me and my friends were in our final years of highschool, we noticed how all the younger kids looked like elementary kids, and we looked younger than the older kids when they were our age then.
There are a few studies showing that there's correlations between testosterone and, well looking older, so that's been my guess for a while now.