The father had not returned their children at the designated time