In this paper, we present a prototype system, which uses CAVE-based virtual reality to enhance immersion in an augmented reality environment. The system integrates virtual objects into a real scene captured by a set of stereo remote cameras. We also present a graphic processing unit (GPU)-based method for computing occlusion between real and virtual objects in real time. The method uses information from the captured stereo images to determine depth of objects in the real scene. Results and performance comparisons show that the GPU-based method is much faster than prior CPU-based methods.

1.
Sekuler
,
A. B.
, and
Palmer
,
S. E.
, 1992, “
Perception of Partly Occluded Objects: A Microgenetic Analysis
,”
J. Exp. Psychol. Gen.
0096-3445,
121
, pp.
95
111
.
2.
Breen
,
D. E.
,
Whitaker
,
R. T.
,
Rose
,
E.
, and
Tuceryan
,
M.
, 1996, “
Interactive Occlusion and Automatic Object Placement for Augmented Reality
,”
Comput. Graph. Forum
1067-7055,
15
(
3
), pp.
11
22
.
3.
Gibson
,
S.
,
Cook
,
J.
,
Howard
,
T.
,
Hubbold
,
R.
, and
Oram
,
D.
, 2002, “
Accurate Camera Calibration for Off-Line, Video-Based Augmented Reality
,”
International Symposium on Mixed and Augmented Reality
, Darmstadt, Germany, Sept.
4.
Lepetit
,
V.
, and
Berger
,
M. O.
, 2000, “
A Semi-Automatic Method for Resolving Occlusion in Augmented Reality
,”
Proceedings of IEEE Conference on Computer Vision Pattern Recognition
, pp.
2225
2230
.
5.
Schmidt
,
J.
,
Niemann
,
H.
, and
Vogt
,
S.
, 2002, “
Dense Disparity Maps in Real-Time With an Application to Augmented Reality
,”
Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision
, pp.
225
230
.
6.
Duchesne
,
C.
, and
Hervé
,
J. Y.
, 2000, “
A Point-Based Approach to the Interposition Problem in Augmented Reality
,”
Proceedings of the International Conference on Pattern Recognition
, pp.
1261
1265
.
7.
Berger
,
M. O.
, 1997, “
Resolving Occlusion in Augmented Reality: A Contour Based Approach Without 3D Reconstruction
,”
Proceedings of the IEEE Conference on Computer Vision Pattern Recognition
, pp.
91
96
.
8.
Kanbara
,
M.
,
Okuma
,
T.
,
Takemura
,
H.
, and
Yokoya
,
N.
, 2000, “
A Stereoscopic Video See-Through Augmented Reality System Based on Real-Time Vision-Based Registration
,”
Proceedings of the IEEE Virtual Reality 2000 Conference
, pp.
255
262
.
9.
Kiyokawa
,
K.
,
Kurata
,
Y.
, and
Ohno
,
H.
, 2000, “
An Optical See-Through Display for Mutual Occlusion of Real and Virtual Environments
,”
Proceedings of IEEE and ACM International Symposium on Augmented Reality
, pp.
60
67
.
10.
Gordon
,
G.
,
Billinghurst
,
M.
,
Bell
,
M.
,
Woodfill
,
J.
,
Kowalik
,
B.
,
Erendi
,
A.
, and
Tilander
,
J.
, 2002, “
The Use of Dense Stereo Range Data in Augmented Reality
,”
Proceedings of the International Symposium on Mixed and Augmented Reality
, pp.
14
23
.
11.
Purcell
,
T. J.
,
Buck
,
I.
,
Mark
,
W.
, and
Hanrahan
,
P.
, 2002, “
Ray Tracing on Programmable Graphics Hardware
,”
Proceedings of ACM SIGGRAPH
, pp.
703
712
.
12.
Purcell
,
T. J.
, 2004, “
Ray Tracing on a Stream Processor
,” Ph.D. Thesis, Stanford University, Stanford, CA.
13.
Sinha
,
S.
,
Frahm
,
J.
,
Pollefeys
,
M.
, and
Genc
,
Y.
, 2006, “
GPU-Based Video Feature Tracking and Matching
,”
EDGE 2006, Workshop on Edge Computing Using New Commodity Architectures
, Chapel Hill.
14.
Fung
,
J.
, and
Mann
,
S.
, 2005, “
Openvidia: Parallel GPU Computer Vision
,”
Proceedings of the 13th Annual ACM international Conference on Multimedia
, pp.
849
852
.
15.
Kovac
,
J.
,
Peer
,
P.
, and
Solina
,
F.
, 2003, “
Human Skin Colour Clustering for Face Detection
,”
Proceedings of the International Conference on Computer as a Tool
, pp.
144
148
.
You do not currently have access to this content.