The shifter is connected to the tranny. When you hit the gas, the engine/tranny assembly torques on the rubber engine mounts a bit, enough to pull on the shifter linkage, which moves the shifter a bit. If it gets 'worse', moves more, better have the engine mounts looked at.