Abstract
Recently, augmented reality has become very popular and has appeared in our daily life with gaming, guiding
systems or mobile phone applications. However, inserting object in such a way their appearance seems natural is still an
issue, especially in an unknown environment. This paper presents a framework that demonstrates the capabilities of
Kinect for convincing augmented reality in an unknown environment. Rather than pre-computing a reconstruction of the
scene like proposed by most of the previous method, we propose a dynamic capture of the scene that allows adapting to
live changes of the environment. Our approach, based on the update of an environment map, can also detect the position
of the light sources. Combining information from the environment map, the light sources and the camera tracking, we
can display virtual objects using stereoscopic devices with global illumination effects such as diffuse and mirror
reflections, refractions and shadows in real time.
