As soon as things starting getting serious
After everything that went down with the first Hunger Games, they should have known better and included him from the beginning. He deserved that and with his talking skills, they should have known, he'd be a big help.