I'm going to go with the he had a bunch of clothes at the house theory. He had taken the jacket off in the second scene with Maddie. And the one he was wearing when he showed up at the house looked much heavier. So maybe he rethought his jacket selection when he went to leave again
