Wide waist and poofed out rib cage are what held him back. When he was at his prime, he had good size everywhere and great conditioning. Then his body clearly started rejecting the drugs and it was a shit show at that point. He did the best thing he could and threw in the towel and down sized big time. I'd say he definitely hit his potential for what he has.
I disagree that he had "good size" everywhere. He seemed to be one who lived/died by the scale, constantly boasting about how he was 300+ lbs, but nearly all of that weight was in his torso and massive ripped glutes of peace. He had average arms, tiny delts and smaller legs. Brought great conditioning sure, but that torso was a liability much likes Kovacs' was even when he was just starting out. It just isn't aesthetic at all.
Look at how tiny he was and this was probably late 80s or maybe even early 90s. Dude just wasn't meant to hold that mass!