I think it' not just the loss of controll.. I would see he really had lost the ability to trust without doubt, and foremost he lost the believe in being worth something else then just the money he earns.. that was the only thing his father appreciated on him, because he could come to him and beg for it.. and Brian did support his father even if he disliked him...
Brian was taught from being a child on that he isn't wanted and loved or even worth to be loved..