If you get physically violent with children when you're frustrated, you shouldn't be in a childcare job, because children are frustrating. They can't help it. It's the responsibility of the actual adult in the situation to be an adult and deal with their anger in a way that isn't violent.

You did the right thing, OP.