Translator Disclaimer
3 December 2019 Projection mapping onto deformable nonrigid surfaces using adaptive selection of fiducials
Author Affiliations +

Recently, many researchers have studied fiducial-based tracking of deformable nonrigid surfaces for projection mapping purposes, but efficient handling and representation of fine deformations and sharp contours in such surfaces still remain a challenge. On top of existing fiducial-based projection mapping methods, much effort is still required to achieve a projection mapping that is free from geometric errors, misalignments, and artifacts in the areas that contain such deformations. According to our observation, this is due to the fact that methods relying on fiducial markers have used markers that sparsely represent the projection surface, are large in size, and projector–camera registration is not accurate enough. We propose a method that enables us to accurately track a deformable nonrigid surface and project textures onto it, ensuring that no visible misalignments occur. We achieve this by proposing a fiducial marker design followed by an adaptive method for fiducial selection to adequately model the deformations in a nonrigid projection surface. Our proposed marker is scalable in size and provides several advantages, such as robust detection under strong deformations and support for adaptively varying fiducial marker density, which enables us to handle the aforementioned deformations with increased accuracy. We have demonstrated our results using a sheet of paper and a cloth under several geometric deformations. Our experimental results show compelling results in terms of geometric accuracy.

© 2019 SPIE and IS&T 1017-9909/2019/$28.00 © 2019 SPIE and IS&T
Bilal Ahmed and Kwan H. Lee "Projection mapping onto deformable nonrigid surfaces using adaptive selection of fiducials," Journal of Electronic Imaging 28(6), 063008 (3 December 2019).
Received: 12 May 2019; Accepted: 13 November 2019; Published: 3 December 2019


Studio production system for dynamic 3D content
Proceedings of SPIE (June 23 2003)
Creating interactive 3D media with projector-camera systems
Proceedings of SPIE (January 18 2004)
Scalable large format 3D displays
Proceedings of SPIE (February 24 2010)
Per-pixel camera calibration for 3D range scanning
Proceedings of SPIE (January 17 2005)

Back to Top