It's because the pull from every direction is exactly the same. This is obvious from the center, but as you move to one side, you're closer to that side, which increases its pull, but this is exactly offset by the fact that there's now MORE mass on the other side.