A group of researchers demonstrated a powerful Stereoscopic 3D photo editor at SIGGRAPH2010 Asia, and the demonstration video is now available online.  In the video, they show first a nice object classification system that works on stereo pairs, and then show some amazing cut-n-paste tools they’ve created.  The tools can properly correct perspective as you move the objects around, properly handle depth and occlusion, and even add shadows via a real-time ambient occlusion algorithm.

The results are impressive, and really have to be seen to be believed.  (PS: You’ll want some Anaglyph glasses handy to really appreciate the later half of the video). Read their paper here.

YouTube – Stereoscopic 3D Copy & Paste.