My response:
Only if you allow it. If the order says one thing, and you're allowing him to do another, then what's the gripe ?
If you don't want him to see the children everyday, then tell him so. Show him the paperwork !
But, unless his seeing the children is causing them to be upset, why not let him have as much time as possible ?
The welfare of your children come first. There's a lot of children who rarely, or never, get to see, hear, or be with, their parent. Your children are fortunate.
If you can, allow your children to be first, and put your feelings aside.
IAAL