You have not lived together for many years, but she allows you vistiation when you are not in a relationship with others?
ok, you may want to contact an attorney about filing for custody or to establish actual court ordered visitation.
WWW.attorneypages.com.
If you don't see one there, then you might try your local bar association to see if they have a referral list.