Why is summer caused by Earth's tilt rather than its distance from the Sun?

A tilted hemisphere receives more direct sunlight for longer each day. Earth is actually closest to the Sun during January, in northern winter.