I find it weird when Dumbledore isn't wearing his pointy hat. But that scene is important because he's leaving Hogwarts to help Harry find the locket so technically, his hat is a symbol of him being Headmaster at Hogwarts and he's not a Headmaster to where he & Harry are going.
