Loading...
 
MATRIS Project

Image

Markerless Real-time Tracking for Augmented Reality Image Synthesis.

There are many applications in which it is necessary to overlay a computer-generated object onto a real scene in real-time, requiring accurate measurements of the position, orientation and focal length of a camera in real-time, by analysis of the camera images and exploitation of unobstrusive inertial motion sensors. This will enable the system as a whole to determine its location and orientation in a very natural way, mimicking the way a human orients himself, using the vestibular organ (in the ears), which is essentially an inertial measurement unit, and the eyes - essentially comparable to a camera.

The goal of the project is to construct be a marker-free tracking system that works with high frame-rate on a low-performance computer unit. It will allow the capture of camera and head motions respectively for TV production and mobile augmented reality applications. As the system will not require markers or special infrastructure, it will be suitable for applications where existing tracking systems cannot easily be used, including:

  • insertion oif virtual objects in live broadcast images outside of a dedicated virtual studio environment, such as graphics for sports or virtual objects in a conventional TV studios
  • augmented reality applications in the area of development, production and service
  • augmented reality for architecture, design and cultural heritage


More information on the MATRIS project is available via the official project website.

Flash player not available.

Kevin Koeser, Bogumil Bartczak and Reinhard Koch:
Robust GPU-Assisted Camera Tracking using Free-form Surface Models
Journal of Real-time Image Processing 2007(2):133-147, Springer-Verlag, Berlin, Heidelberg
The original publication is available at www.springerlink.com
Demo Video with changing light, blooming, moving persons, ... full-res 54MB low-res 7MB

Bogumil Bartczak, Kevin Koeser, Felix Woelk and Reinhard Koch:
Extraction of 3D Freeform Surfaces as Visual Landmarks for Real-Time Tracking
Journal of Real-time Image Processing 2007(2):81-101, Springer-Verlag, Berlin, Heidelberg
The original publication is available at www.springerlink.com
A reconstructed living room
A Fish-eye camera video from a TV show Perspectively undistorted and augmented

Kevin Koeser, Bogumil Bartczak and Reinhard Koch:
An Analysis-by-Synthesis Camera Tracking Approach based on Free-form Surfaces.
Proceedings of DAGM 2007, Heidelberg (LNCS 4713, pp. 122–131), (BibTeX)
The original publication is available at www.springerlink.com
DAGM 2007 Paper Award of the German Association for Pattern Recognition !
Demo Video with changing light, blooming, moving persons, ... full-res 54MB low-res 7MB

G. Thomas, J. Chandaria, B. Bartczak, K. Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, F. Gustafsson, J. D. Hol, T. B. Schön, J. Skoglund, P. J. Slycke, S. Smeitz:
Realtime Camera Tracking in the MATRIS Project
SMPTE Motion Imaging Journal 2007 (07/08), Society of the Motion Picture and Television Engineers, London, 2007

Kevin Koeser, Bogumil Bartczak and Reinhard Koch:
Drift-free Pose Estimation with Hemispherical Cameras
Proceedings of CVMP 06, pp. 20-28, November 2006, London
Demo Video 9MB

Kevin Koeser, Volker Haertel and Reinhard Koch:
Robust Feature Representation for Efficient Camera Registration
LNCS 4174 (DAGM 2006), pp. 739–749, September 2006, Berlin, Germany

J. Chandaria, G. Thomas, B.Bartczak, K.Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, J. Hol, T. Schön, J. Skoglund, P. Slycke, S. Smeitz:
Real-time Camera Tracking in the Matris Project, International Broadcasting Convention (IBC), Amsterdam, 2006, pp. 321-328

Jan-Michael Frahm, Kevin Koeser, Daniel Grest and Reinhard Koch:
Markerless Augmented Reality with Light Source Estimation for Direct Illumination.
Proceedings of CVMP 2005, pp. 209-218, London, December 2005
DEMO Video (WMV 26MB)

Reinhard Koch, Kevin Koeser, Birger Streckel, ))Jan-Friso ?Evers-Senne((:
Markerless Image-based 3D Tracking for Real-time Augmented Reality Applications.
WIAMIS 2005, Montreux, Switzerland, April 13-15 2005.

))Jan-Michael(( Frahm, Kevin Köser and Reinhard Koch:
Pose Estimation for Multi-Camera Systems.
26th DAGM Symposium, pp. 27-35, Tübingen, Germany, August 2004, ))Springer-Verlag(( .




Created by tos. Last Modification: Tuesday 29 of April, 2008 16:20:38 CEST by admin.