I wouldn't want to cast aspersions on your honesty.

我可不想批评你的诚信。