In general I think there will not be a unique solution.
You can seperate it into two problems of three unknowns each: position and orientation. First assume that the camera does not introduce unknown distortions (f'rinstance by projecting the sphere onto a flat piece of film). Disregard orientation for a minute and what you are measuring is angular seperation between the objects. From here on I will assume that there are only three points and that you can distinguish them-- they're different colors or something. Measuring the angle between two known points puts you on a 2-dimensional surface in space (I can't plot up graphics easily, but they look sort of like electric field lines). Adding another point will put you on another, intersecting surface; there is lots of degeneracy and it's not obvious that the equations have a clean exact solution.
It's worth noting that every pair you look at imposes volume constraint, so it might be useful to look at the most obtuse angles first and put some bounds on where the camera can be.
If you can determine position, then orientation is easy, and requires only two (non-eclipsing) points.