In this paper, we present a prototype system, which uses CAVE-based virtual reality to enhance immersion in an augmented reality environment. The system integrates virtual objects into a real scene captured by a set of stereo remote cameras. We also present a graphic processing unit (GPU)-based method for computing occlusion between real and virtual objects in real time. The method uses information from the captured stereo images to determine depth of objects in the real scene. Results and performance comparisons show that the GPU-based method is much faster than prior CPU-based methods.
Issue Section:
Technical Briefs
1.
Sekuler
, A. B.
, and Palmer
, S. E.
, 1992, “Perception of Partly Occluded Objects: A Microgenetic Analysis
,” J. Exp. Psychol. Gen.
0096-3445, 121
, pp. 95
–111
.2.
Breen
, D. E.
, Whitaker
, R. T.
, Rose
, E.
, and Tuceryan
, M.
, 1996, “Interactive Occlusion and Automatic Object Placement for Augmented Reality
,” Comput. Graph. Forum
1067-7055, 15
(3
), pp. 11
–22
.3.
Gibson
, S.
, Cook
, J.
, Howard
, T.
, Hubbold
, R.
, and Oram
, D.
, 2002, “Accurate Camera Calibration for Off-Line, Video-Based Augmented Reality
,” International Symposium on Mixed and Augmented Reality
, Darmstadt, Germany, Sept.4.
Lepetit
, V.
, and Berger
, M. O.
, 2000, “A Semi-Automatic Method for Resolving Occlusion in Augmented Reality
,” Proceedings of IEEE Conference on Computer Vision Pattern Recognition
, pp. 2225
–2230
.5.
Schmidt
, J.
, Niemann
, H.
, and Vogt
, S.
, 2002, “Dense Disparity Maps in Real-Time With an Application to Augmented Reality
,” Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision
, pp. 225
–230
.6.
Duchesne
, C.
, and Hervé
, J. Y.
, 2000, “A Point-Based Approach to the Interposition Problem in Augmented Reality
,” Proceedings of the International Conference on Pattern Recognition
, pp. 1261
–1265
.7.
Berger
, M. O.
, 1997, “Resolving Occlusion in Augmented Reality: A Contour Based Approach Without 3D Reconstruction
,” Proceedings of the IEEE Conference on Computer Vision Pattern Recognition
, pp. 91
–96
.8.
Kanbara
, M.
, Okuma
, T.
, Takemura
, H.
, and Yokoya
, N.
, 2000, “A Stereoscopic Video See-Through Augmented Reality System Based on Real-Time Vision-Based Registration
,” Proceedings of the IEEE Virtual Reality 2000 Conference
, pp. 255
–262
.9.
Kiyokawa
, K.
, Kurata
, Y.
, and Ohno
, H.
, 2000, “An Optical See-Through Display for Mutual Occlusion of Real and Virtual Environments
,” Proceedings of IEEE and ACM International Symposium on Augmented Reality
, pp. 60
–67
.10.
Gordon
, G.
, Billinghurst
, M.
, Bell
, M.
, Woodfill
, J.
, Kowalik
, B.
, Erendi
, A.
, and Tilander
, J.
, 2002, “The Use of Dense Stereo Range Data in Augmented Reality
,” Proceedings of the International Symposium on Mixed and Augmented Reality
, pp. 14
–23
.11.
Purcell
, T. J.
, Buck
, I.
, Mark
, W.
, and Hanrahan
, P.
, 2002, “Ray Tracing on Programmable Graphics Hardware
,” Proceedings of ACM SIGGRAPH
, pp. 703
–712
.12.
Purcell
, T. J.
, 2004, “Ray Tracing on a Stream Processor
,” Ph.D. Thesis, Stanford University, Stanford, CA.13.
Sinha
, S.
, Frahm
, J.
, Pollefeys
, M.
, and Genc
, Y.
, 2006, “GPU-Based Video Feature Tracking and Matching
,” EDGE 2006, Workshop on Edge Computing Using New Commodity Architectures
, Chapel Hill.14.
Fung
, J.
, and Mann
, S.
, 2005, “Openvidia: Parallel GPU Computer Vision
,” Proceedings of the 13th Annual ACM international Conference on Multimedia
, pp. 849
–852
.15.
Kovac
, J.
, Peer
, P.
, and Solina
, F.
, 2003, “Human Skin Colour Clustering for Face Detection
,” Proceedings of the International Conference on Computer as a Tool
, pp. 144
–148
.Copyright © 2009
by American Society of Mechanical Engineers
You do not currently have access to this content.