I do not think anyone says let him do as he wants.
I will say this...and let me stress it is dependent on the situation/case....custody/visitation orders are more for the protection of the NCP's rights than the CP..next is the child.
We as Americans have rights,law cannot tell us how to live,work,what religion or how to raise our children. Orders are not punishment...every parent has the right to visitation/access before they ever enter a court room....the courts and the order only establish how everyone's rights will be protected and guaranteed. The order spells out the NCP rights...it is a guideline. Does your order say anything about visitation..or whereas both parties agree....if by court and no issues(abuse,etc) I am thinking it probably does. The order is the min....by law..the NCP has a right..the same as CP...the only way to guarantee both parents are not denied the right to access child is.....to establish an amount of time,guaranteed,protected.....this is the only way gov. can ensure and protect parental rights without stepping over the boundaries of interference with privacy,family,etc......The 'authorities' on children have said structure,stabilty and consistancy are best interest of child.
This is why we have our orders..courts 1st job=child..schedule guarantees a min standard of structure,etc for child w/out overstepping boundaries of/in family/privacy. The schedule which is a guideline really..guarantees 2nd parent's rights to access of child/relation and that on consistant basis...meaning cp can't go 3 months w/o letting other parent visit.
Frankly, ex gave you reason (step kids)...doesn't have too at all..needs no reason to ask for extra time and it is not your place to judge if reasons deserve the time. Walk in the other shoes.
I do not know what you mean that ex won't give, explain if you like.....2 wrongs do not make a right.
If there is no reason to say no to extra time such as you have plans already,etc....you should not....your child has rights also and one is to have relation with other parent w/o your interference or govern. I always suggest if you question what you are doing.....imagine a courtroom,you standing before a judge that asks you...why did you make this or that choice?
What would you say? If you think the judge and the law will back your choice, fine......if you were still married,is this what you would choose....if it all reversed,would I want ex to make these choices about me?
If you feel you are getting taken advantage of with allowing extra time it is very easy to set some limitations & have added to your agreement such as asking for the change so many days in advance,if involves Holidays notice time more,etc...it still leaves you, the cp with same control and no power.
It is hard for all and you may feel you do all the work & why on top do you have to bend any for other that you feel does none of work. My ex left in middle of labor to go home & shower..and I mean middle as in 10 cent.,get ready to push....next A.M. picked us up,drove us home & within20 mins left for work(he had the week off,work called shorthanded & he agreed to pick up slack & we didn't need the $)so you are not alone. He is an a_ _ but all of that is with me, I do not view as less caring of child and many things ex's do may look like an example of not caring for child but is probably more about the other parent & lets face it...the child is the only way to affect other parent thus they are many times used as tools/weapons. I have found in my case..as long as I kept acknowledging every little thing,judging ex,motives,etc...the battle raged. As I began to ignore small, trivial things,etc...things did calm down. It is not as much fun if they(cp or ncp) can not get you mad,yelling,woried,etc....
I hope you can work it all out..only you know all the issues/facts. It is tough, I would wish it on no one.