I have been deterred from doing this by the argument that I should thus be advising him to cast away his only adherents.

我在行动时有所踌躇，是因为人们认为，这种做法等于劝告他抛弃身边仅有的追随者。