take one’s leave

See: abandon