It would be most ungracious and impolite to refuse a simple invitation to supper with him.

连与他共进晚餐这样的简单邀请都拒绝会显得非常失礼，没有教养。