Because after he got his soul back he didn't think he deserved Buffy and after what happened he didn't think she would ever love him and that was before their last nights together which I think could have changed things some in his mind.

I still partly think he believed her at first but as time went on and couldn't go to her started to doubt it.