Is dating a guy with a child a bad idea?

Every time he talks about his baby;s mother he shrugs and speaks in anger, is that normal? It makes me feel uncomfortable. I adore his son but i feel like some how he will never trust me with his child.