Removing unsrung weight (suspension, wheels, tires, etc.) will improve handling and ride quality, but it's still weight that has to accelerate from 0 to 60 MPH.
If by moving, you mean spinning, then yes. It's a HUGE difference, although it gets complicated because the farther mass is from the...