Also the fact that their whole friendship it felt like he had been dishonest. Remember how Foggy was upset about all the times Matt could hear his heartbeat and know if he was lying. He felt like he invaded his privacy.