I think Toby is willing to wait for her because he's so confident that she actually feels the same way and is just afraid to take the leap. If she ever flat out said she didn't have feelings for him (and was being truthful, because Toby would know if it was a lie) I think he would move on. Right now he's just really sure that someday it's going to happen. I don't think it will take the whole season for her to come around though.