For the last 10-15 years it's been a boiling frog situation really - .1 or .2" increase every generation until 7" somehow becomes the norm (for a phone, not a tablet, mind you).
Phablets were more like an iPad Mini than an iPhone Pro Max back then. They were huge compared to the biggest phones around. I remember seeing people talking on the street with highe phones pressed to their cheeks.