He got on with Gronk too.
From what I remember they had a good professional relationship but that's it. Brady is supposed to be the only member of the Patriots organization that would talk with him about none football things. IIRC he was supposed to be a bit strange and people weren't comfortable around him.