Ya, you're right. It's not a huge step, though.
Here are the some truths:
-The Pats have the #1 offense in the NFL (ppg) and their schedule has been and is pretty brutal.
-They have shitload of offensive weapons, including two TE's that no one has had an answer for thus far.
-They have a HOF qb and coach
-Their young defense has a lot of potential and will continue to get better as the season wears on
- They have remained pretty healthy thus far
- Pro bowl guard Logan Mankins will return after week 10.
So yes, they are probably the third best team in the AFC, but when the going gets tough, they have the tools to win a head to head game with any of the teams mentioned in your post.
They won't win the sb this year, but so what...when your team is 5-1 during a "transition year", it don't get much better than that.