I find that a lot of the time, OpenGL will show you it failed by not drawing anything. I'm trying to find ways to debug OpenGL programs, by inspecting the transformation matrix stack and so on. What is the best way to debug OpenGL? If the code looks and feels like the vertices are in the right place, how can you be sure they are?
There is not straight answer. It all depends on what you are trying to understand. Since OpenGL is state machine, sometime it does not do what you expect as required state is not set or things like that.
In general, use tools like glTrace / glIntercept (to look at OpenGL call trace), gDebugger (to visualize textures, shaders, OGL state etc.) and paper/pencil :). Sometimes it helps to understand how you have setup camera and where it is looking, what is being clipped etc. I have personally relied to last more than previous two approaches. But when I can argue that depth is wrong then it helps to look at trace. gDebugger is also the only tool that can be used effectively for profiling and optimization your OpenGL app.
Apart from this tool, most of the time it is the math that people get it wrong and it can't be understood using any tool. Post on OpenGL.org newgroup for code specific comments, you will be never disappointed.
Hope this answers your question!
GLIntercept is your best bet. From their web page:
- Save all OpenGL function calls to text or XML format with the option to log individual frames.
- Free camera. Fly around the geometry sent to the graphics card and enable/disable wireframe/backface-culling/view frustum render
- Save and track display lists. Saving of the OpenGL frame buffer (color/depth/stencil) pre and post render calls. The ability to save the "diff" of pre and post images is also available.
There is also the free glslDevil: http://www.vis.uni-stuttgart.de/glsldevil/
It allows you to debug glsl shaders extensively. It also shows failed OpenGL calls.
However it's missing features to inspect textures and off screen buffers.
For those on Mac, the buit in OpenGL debugger is great as well. It lets you inspect buffers, states, and helps in finding performance issues.