You don't have to be alone with him and I don't think you ought to be.

你没必要和他单独相处，而且我认为你不应该和他单独相处。