He'd rather not have had a neighbor of any kind, but especially one who kept track of his comings and goings.

他不希望与任何人作邻居，尤其不希望与知道他行踪的人作邻居。