Is there any Algorithm for converting 2d video into 3d video? (for viewing using glasses)
(a-la turning Avatar into Avatar for An IMAX 3D Experience ) or at least turn it into video prepared for feeling some 3d viewing using
a-la
or
I know my question is asked(expressed) not in the best way so feel free to edit.
Not really. Should the algorithm somehow understand the scene content and extrapolate depth information from that? Remember that 3D video needs depth information. Otherwise there is no way of knowing how much to offset the two frame parts.
You could probably try it by assigning various depths to various degrees of being out-of-focus but I doubt something usable would come out.
No - 3D video require that extra information (depth) be present that simply isn't contained in 2D video.
If you have a 2D rendering of a sceene (for example in Toy Story) then its quite easy to produce a 3D film - you just change the viewing angle of the sceene and re-render.
Well, Stanford does have an algorithm for converting 2D photos into 3D models. My guess is that with movies it should be even easier, because then you have several photos instead of just one, so you can extract much more information about depth by comparing neighboring frames.
Arguably, the results will never be quite as good as when you just render/shoot the movie in 3D to begin with.
Hi, on this year's ces show toshiba presented the cell-tv display and they claim that it is able to convert 2d tv-signals into 3d. I don't know if it produces a good result or what algo they are using, but if they are true there should be an algo for this.
But unfortunally I don't know how it could be done.
Andreas
There are existing algorithms for extracting 3D shapes from 2D images, here, or here, for example. You can extract shapes from each frame of video, and even use multiple frames to gain better understanding of shapes by detecting their motion.
However, odds are that the results will be of nowhere near the standard quality of content of a 3D movie.
No individual algorithm per say, but yes, it is possible. It is very hard. There are people working on this problem right now. The algorithms involved are very challenging to write, they don't always work right, and any complete solution would require a large amount of processing power. Any solution would be offline (instead of real time) at first.
3D perception isn't tied as closely to stereo optics as you might believe. If you think you need two eyes to see 3D, then try walking around with an eyepatch on. You'll do just fine. There are a (small) number of programs out there, including some commercial software packages, that create 3D models from sets of 2D pictures without a stereo camera. Some run online, constructing a more detailed model as more of it is seen.
Just thinking about it I can think of some problems you'd run into with movies in particular. For example, I could imagine mattes getting rendered at an incorrect depth. Videos with special effects from software like Apple Motion might end up with strange artifacts.
There was some research done on this at a place I once worked (although I wasn't involved with it at all). This paper, Automatic extraction of 3D models from an airborne video sequence might be helpful.
It cannot work in general for a very simple reason: Suppose you have a scene with a window in a wall showing a beach, and beside that, you have a photograph showing a window in a wall showing a beach. How can the algorithm differentiate between the two? How can you detect what is reality with depth and what is just a flat photograph?
Maybe there will be an algorithm for emulating stereoscopic views, but it cannot be the same.
The reason is quite simple. In a 2D video is not only missing the depth information (which is not sufficient for getting a stereoscopic video), but it is missing the hidden surfaces which would be visible from another point of view.
Everyone could think that the depth information could be extrapoled from the available information, and this is true. But, the missing information cannot be so accurate for having a good stereoscopic effect.
Apart from that, I've heard about a system which coudl extract accurate 3D models from 8 (eight!) cameras pointing on the same target. It is so accurate to emulate also clothes movements correctly. However, this is done processing 8 (eight!) 2D videos. How it could be possible to achieve the same result with only one 2D video?
The achivement of the wanted result depends essentially by the information availability, and in this case (IMHO) there is not enought information. Althought, it could be possible to try to emulate stereoscopic effect from a 2D video, but essentially it needs an hard work, long processing and the consequence is low quality result respect an original stereospic video.
I would like to remember that the 3D view is generated by our brain. The eyes can capture only 2D images, and our brain, processing the two images can generate a depth view of the seen objects.
Our company developed a software can convert 2D to 3D. If you are interested, pls email me([email protected]). I can give your some details. My name is Sherry. Working in Nanjing, China.
You should probably understand the difference between polarizing glasses and red/blue glasses. The red/blue glasses 3d effect is simple to do. You simply need to take a picture about a couple inches apart (kind of like how are eyes are laid out) and super impose each image over the other. There is a tutorial on how to do this here: http://www.scec.org/geowall/makeanaglyph.html
As for the polarizing glasses effect, this is a little harder. If you go to a movie theatre and watch a 3D movie with polarizing glasses, you are seeing true 3D. How it works is the cinema has 2 projectors. One projector is projecting the movie in one type of polarization and the second projector is projecting the movie at the other type of polarization. The images are overlaid right on top of each other so if your wearing your 3D polarizing glasses, it appears in 3D.
This can't be done as easily with a TV or computer monitor. Your TV or monitor would have to project 2 images simoultaniously. Due to the popularity of 3D now though, there are 3D TVs and monitors appearing on the market that do not project 2 images, but display 3D. Here's how they work:
A normal computer screen or TV refreshes at a frequency of 60hz. This means 60 times in 1 second, the image you see is being refreshed. Because this is so fast, the human eye doesn't see flicker. 3D TVs and monitors refresh at 120hz. The polarizing images are interchanges at a rate of 120 times per second, but since there are 2, it appears at 60 times a second, which is what produces the 3D effect.
Hope this helps you understand a little.
To answer your question, yes you can create 3D videos, but you would need a 3D monitor and 3D TV to watch it.