Did i cross my boundaries, like he says?

No, you didn't cross the boundary. If he can talk to her, why can you talk to her. He is afraid because you will find out things.