Basically, what you learn in high scool is enough for game programming, exept if you want to code your own 3D engine where some basic linear algebra will be required but nothing too serious.
The only reason those annoying calculus and physics course are mandatory in universities is just to show off, and to make sure only the most intelligent people makes it to higher degrees.
I know what I'm talking about since I had to endure this until last year. Now it seems to me it was forever ago and I probably forgot 100% of the complex calculus I learned (not mathematically complex - I meant technically complex - By the way I use complex numbers in EE regularly, but it's just the basics, not the "technically complex" stuff). I'd be completely unable to pass the exams I passed the last couple of years ago again, how ironical. But since about 97% of other students are in the same case, I guess it's meant to be like this, and that this is "normal".
Back to the topics, the only mathematical needs are :
- Basic movement stuff, velocity, acceleration, etc...
- Trigonometry, how to do circles with sin/cos, etc...
- If you're programming a music engine, knownledge in exponentials and logarhtms will be required.
- If you're programming a 3D engine, knownledge about projection matrices, and vectors
- This is more computer science than math, but I can't stress how important is to know well how to count in binary/hex, and to use fixed point representations of numbers. Those are used everywhere in games.