I have a custody agreement court order with my ex for my 2yr old son there is nothing in the court order?

about visitation except as the party's mite mutually agree i have secondary physical custody consisting of such periods of reasonable liberal and substantial custody as the parties shall mutually agree ..so when i have my son do i have to bring him back to the Father or can i keep him until the court hearing? and is the court oback even still in place considering we are going back to court and he has already broken the ourt order?