Because when you cut the 5v, you disable the power to the MCU inside the drive, making it stop all processing internally. The servo circuitry only reacts on commands given by the MCU so they won't do anything with the MCU (drive Micro Controller Unit, the actual drive CPU) powered off.
So the mcu has no power, and its connected to a device that is powered?
That doesn't sound like such a good idea, why not just use a dpst?