You did not want people to think that you were associating with someone who was socially beneath you.

你不想人们认为你和社会地位底下的人有瓜葛吧。