Revision as of 16:22, 26 July 2006

Accessing the KDE-menu using the system (2.72 MByte video)

Developed by Juan Roldan, ERASMUS exchange student from Cordoba, Spain

Camera-Projector System

Application

A software for camera-projector interaction was developed by Juan Roldan at the Microsystem & Machine Vision Laboratory (MMVL) at Sheffield Hallam University, UK.

The software makes use of a low cost off-the shelf webcam that is calibrated against a standard projector screen. The webcam is used to determine the position of physical pointer (e.g. a pen) which is then used to virtually move the X11 pointer. Point-and-click functionality has also been implemented.

The vision system uses the Mimas real-time computer vision toolkit developed by the MMVL.

How it works

Mouse clicks

The standard deviation of a few recent mouse-positions is used as a criterion, wether the mouse is stationary or moving. If the mouse is stationary, a mouse click is issued.

Future Work

UML-diagram of proposed static structure of future software version

UML-diagram of proposed collaboration of future software version

• More different mouseevents
• KDE-miniprogram with configuration wizard

Gallery

Interactive camera-projector system	Long demonstration of the prototype-system (11.4 MByte video)	Short interactive slides presentation with the system (6.3 MByte video)
Browsing the file-system and trying to play minigolf (14.4 MByte video)	Playing Reversi against the computer (5.54 MByte video also available at video.google.co.uk)	Calibration of the screen using projected patterns

Downloads

You first need to install the 4th unofficial release of Mimas-2.0 (28 MByte) of the Mimas Real-Time Computer Vision Library to be able to compile and run version 1.4 of the interactive software (229 kByte).

See Also

• Mimas Camera Calibration
• Student Projects Available

External Links

• Edward Tse - Interactions Inventor
• Multi-Touch Interaction Research
• Magic board project by IIHM
• IBM Research on interactive projector
• A Flexible New Technique for Camera Calibration: Zhengyou Zhang
• Creating input events in Linux/X11 using the X11 test interface
• Finger tracking with laser scanner
• LaserGo allows playing Go using a laser-pointer
• The interactive camera-projector system at google video