So in H264 we have something like this as a time line (supposing we all know what I P B frames are but if we do not look here (Wikipedia)) Here "I" frames are compressed fully, "P" frames inharit from ones they follow, "B" frames can inherit from ones they follow and ones that are after them...
So my question is if there is any way (better open source program written in any language) that could somehow convert H264 to xml + images (images = any format=))?
so it could contain something like this or anything similar:
<frame base="1.jpg"/>
<frame>
<base>
1.jpg
</base>
<change content='2.jpg' x='150' y='150'/>
</frame>