The Good Neighbors by Edgar Pangborn

You can’t blame an alien for a little inconvenience–as long as he makes up for it!