How to encode video from multiple cameras into one mkv stream?

Question

How to encode multiple video + audio streams (we want streams not to be any how encoded) from cameras into one mkv so, that sound from camera A is encoded with respect to wideo from camera A, using JAVA or C or C++? (algorithm should be working on different platforms eg win lin mac)

Answer 1

I assume you are looking for video compositing such that multiple videos are laid out in a mosaic synced in time with audio. Check this post out. Several solutions are presented. The poster solved the problem using gstreamer which supposedly works for Windows, Mac and Linux.

I would suggest using something like GStreamer or Avisynth since they will abstract away a lot of the ugly details (decoding, video scaling and translation, video syncing, audio mixing, audio syncing, video output encoding) that would be required if you just used ffmpeg's libavformat and libavcodec directly.

Answer 2

Pavtube Video Converter.You can join multiple videos into one bigger file for conversion, as well as replace the original audio with other music or sounds you like.

http://www.pavtube.com/video_converter/