If the framebuffer isn't activated in the Linux OS you got I know that it is in the Linux OS provided by Linux4Sam. You can always try if it is activated by issuing the command cat /bin/sh > /dev/fb0
; a random pattern should appear on the screen (note that it might be necessary to activate the backlight - if it is turned off you might not see anything at all). You might have to kill the graphical environment that is running on target first.
If all you want to do is to display an image it is possible to do that by opening the framebuffer (/dev/fb0) and write to it (or just cat it); but you have to have an image in the correct format. If I remember correctly the framebuffer in the evaluation board is a RGB555 (i.e. 5 bits for red, 5 bits for green and 5 bits for blue).
If you want to use a GUI library you have to use one that has a framebuffer backend. On a standard Linux system a GUI library assumes that you have X installed but some of them also have framebuffer backends. Qt for instance can be compiled in such a way (but I think you have to modify it to provide the correct color information; it only supports RGB565 out of the box). DirectFB is a simpler solution that provides basic graphic support (but it has support for FreeType giving you good font support). See the links provided above for other examples.