Why does a fever make you shiver when your body is already hot?

The brain temporarily raises its temperature set point. Until the body reaches that target, you feel cold and shiver to generate and conserve heat.