Yup what he said.
If you have the basics, Monitor, keyboard, mouse, midi tower/desktop case & HDD's already then yes its cheaper when replacing your Motherboard, CPU, Ram etc.
Plus the bonus then is you wont have to replace Everything if your upgrading just the graphics, for gaming, or a HDD for extra space.