At some point after he speaks with Anya, Loki makes his way to Wesley's. He even knocks politely and waits patiently for the door to be opened instead of being more...proactive...in entering.

He even looks respectably dressed.

Obviously, Wesley ought to be suspicious.