Not much as your body is designed to regulate temperature to keep it as constant as possible. The reason for the slight increase is that we burn more energy, generating more heat.
Your skin will get hot as your blood vessels dilate to bring heat to the surface where it can be cooled. But as Russ says, your body is designed in ensure that its core temperature changes as little as possible.
