Yeah, for me S7 and S8 were shaky seasons. Peter was obviously still adjusting to being the Doctor in S8 + his dynamic with Jenna. Finally in S9 he hit it but Jenna was leaving the show.
And to date, S10 is Peter's best season for me but then he's leaving. UGH.