Does using car A/C at higher/lower waste more/less gas?

I've been pondering this, but as long as it's on it should make no difference, or at least not a noticeable difference. Am I wrong?