The stars are moving too, but they are so much bigger and farther away than the planets that we don't detect the changes from our perspective.
The only way I can explain it: You're in a car, driving away from Mt. Mauna Loa at 40 MPH. The trees and other objects close by are zooming past, but you look back and Mauna Loa is still looming behind you.