I'm sorry you're going through this.
It must be hard when you still have to interact with him on a daily basis. Is a re-assignment possible as Leanne suggested? Otherwise you'll just have to do your best to deal with him as little as possible and keep it as professional as possible. Maybe one of your friends at work can help run interference for you?
My meeting at the bank was rather boring, but I guess it's good to know that we're on the same page.