AudioQueuePrime Fails with -66674

Question

I have some code which does recording/seeking/playback using AudioQueue using either PCM or IMA4. Now this code is working fine on the simulator but when it's time to use on the iphone playback gives the error -66674 on AudioQueuePrime. I am mostly curious as to what are possible causes to this error as the documentation leaves much to be desired.

I've linked the relevant documentation below, this is done on iphone-sdk-4.0 and again simulator works fine but the device returns this error. I've tried to let AudioQueuePrime prepare all frames as well as requesting a single frame.

http://developer.apple.com/mac/library/documentation/MusicAudio/Reference/AudioQueueReference/Reference/reference.html#//apple_ref/c/func/AudioQueuePrime