I get very irritated when young children are led out of Mass at the Gospel and homily. How should I deal with it?

In our church, there seems to be a custom of leading young children out at the Gospel and homily. I asked my priest about it, and he said it is okay if there is a priest with the children, too. We used to have another priest, but he is gone and the practice continues.

This is very irritating. At our church, it used to be that one didn’t interrupt Mass for anything. Any suggestions about how to deal with this?

Sincerely,
Devoted