I think it's great that they continued this on in S2 when Carson collapses and Mary goes to see him and he tells her to tell Matthew that she loves him because if she didn't, then she might regret it all her life long. To show the depth of this relationship, I don't think even Robert has these types of conversations with Mary.