Vision Based 3D Tracking with Applications to Augmented Reality
In augmented reality applications, tracking and registration of cameras and objects are required because, to combine real and rendered scenes, we must project synthetic models at the right location in real images. We present here an accurate solution that works in real-time even under difficult conditions.
3-D Face Tracking Demo
Our 3D tracking algorithm is robust enough to track a human face, given a rough and generic 3D model of the face. Then virtual objects can be added in a realistic way and in real-time. We use a 2-D face detector to automatically initialize the tracking.
This demonstration was presented at different exhibitions where we successfully tracked the faces of hundreds of people of all ages.
 |
 |
 |
 |
 |
Video |
Rigid Object 3-D Tracking
 |
 |
 |
| Horizontal 360 degree rotation around the object |
Video showing the keyframes [Hires] |
Special Effects from the Seventies |
Combining Edge and Texture Information
We also integrated the ability to take edge-information into account. We propose a method for handling cluttered or textured backgrounds that is similar in speed to approaches that consider only single hypotheses.
 |
 |
| Multiple Hypotheses in Action |
Augmenting a Corridor |
Relevant Publications
Please note that the publication lists from Infoscience integrated into the EPFL website, lab or people pages are frozen following the launch of the new version of platform. The owners of these pages are invited to recreate their publication list from Infoscience. For any assistance, please consult the Infoscience help or contact support.
Stable Real-Time 3D Tracking Using Online and Offline Information
IEEE Transactions on Pattern Analysis and Machine Intelligence. 2004. Vol. 26, num. 10, p. 1391-1391. DOI : 10.1109/TPAMI.2004.92.Please note that the publication lists from Infoscience integrated into the EPFL website, lab or people pages are frozen following the launch of the new version of platform. The owners of these pages are invited to recreate their publication list from Infoscience. For any assistance, please consult the Infoscience help or contact support.
Combining Edge and Texture Information for Real-Time Accurate 3D Camera Tracking
2004. International Symposium on Mixed and Augmented Reality, Arlington, VA, DOI : 10.1109/ISMAR.2004.24.Please note that the publication lists from Infoscience integrated into the EPFL website, lab or people pages are frozen following the launch of the new version of platform. The owners of these pages are invited to recreate their publication list from Infoscience. For any assistance, please consult the Infoscience help or contact support.
Fusing Online and Offline Information for Stable 3D Tracking in Real-Time
2003. Conference on Computer Vision and Pattern Recognition, Madison, WI, USA, p. 241. DOI : 10.1109/CVPR.2003.1211476.Please note that the publication lists from Infoscience integrated into the EPFL website, lab or people pages are frozen following the launch of the new version of platform. The owners of these pages are invited to recreate their publication list from Infoscience. For any assistance, please consult the Infoscience help or contact support.
Fully Automated and Stable Registration for Augmented Reality Applications
2003. International Symposium on Mixed and Augmented Reality, Tokyo, Japan, DOI : 10.1109/ISMAR.2003.1240692.Contacts
| Vincent Lepetit | [email] |