That's reasonable. At the same time you still have Brady which probably makes you good for 10 wins at a minimum. People here like to pretend a season was only successful if you win a Super Bowl which IMO is a load of bollucks. That's something that sounds cool and tough but is incredibly shortsighted.
Anyway, you guys might not be perfect but no team ever is. I'd assume you be fine until the teams proves me wrong on the field.