Interactive Camera-Projector System

(Difference between revisions)
Jump to: navigation, search
m (Downloads)
Line 27: Line 27:
 
|}
 
|}
  
==Future Work==
+
==Changelog==
* More different mouse-events
+
2006-10-20 Jan Wedekind 0.6
* Improved recognition
+
* Minor fixes on configure-script
* More mouse-modes
+
* Test with laser-pointer
+
  
==Gallery==
+
2006-10-20 Jan Wedekind 0.5
{|align="center"
+
* Fixed the check for gfortran (using AC_PROG_FC now). Thanks to Steven G. Johnson!
|-
+
# On the older Mandriva version you may have to configure using
|[[Image:InteractiveArtistic.png|thumb|160px|Artist's impression of the system]]||[[Image:Camera-projector.jpg|thumb|160px|Interactive camera-projector system]]||[[Image:Interactive.jpg|thumb|160px|Long demonstration of the prototype-system (11.4 MByte [http://vision.eng.shu.ac.uk/jan/interactive.avi video])]]||[[Image:Slides.jpg|thumb|160px|Short interactive slides presentation with the system (6.3 MByte [http://vision.eng.shu.ac.uk/jan/slides.avi video])]]||[[Image:Minigolf.jpg|thumb|160px|Browsing the file-system and trying to play minigolf (14.4 MByte [http://vision.eng.shu.ac.uk/jan/minigolf.avi video])]]
+
./configure FLIBS="-lgfortran"
|-
+
 
|[[Image:Reversi.jpg|thumb| Playing Reversi against the computer (5.54 MByte [http://vision.eng.shu.ac.uk/jan/reversi.avi video] also available at [http://video.google.co.uk/videoplay?docid=4201589281466176805 video.google.co.uk])]]||[[Image:Calibrate Screen.gif|thumb|160px|Calibration of the screen using projected patterns]]||[[Image:Interactive2.jpg|thumb|160px|Prototype of early user-interface (13.7 MByte [http://vision.eng.shu.ac.uk/jan/interactive2.avi video])]]||[[Image:MandoWizard.jpg|thumb|160px|Screenshot of the wizard for configuring the recognition algorithm]]||
+
# On openSuSE 10.0 libgfortranbegin.a was compiled without "-fPIC". You need to configure using
|-
+
./configure F77=gfortran FLIBS="-lgfortran"
|}
+
 
 +
2006-10-17 Jan Wedekind 0.4
 +
* Added support for UYVY-cameras.
 +
 
 +
2006-10-16 Jan Wedekind 0.3
 +
* Video display can be zoomed using the mouse-wheel.
 +
* Display error-messages when accessing camera fails.
 +
 
 +
2006-10-13 Jan Wedekind 0.2
 +
* Removed dependency on ImageMagick.
  
 
==Downloads==
 
==Downloads==
Line 50: Line 57:
 
  make
 
  make
 
  ./mando
 
  ./mando
 +
 +
==Gallery==
 +
{|align="center"
 +
|-
 +
|[[Image:InteractiveArtistic.png|thumb|160px|Artist's impression of the system]]||[[Image:Camera-projector.jpg|thumb|160px|Interactive camera-projector system]]||[[Image:Interactive.jpg|thumb|160px|Long demonstration of the prototype-system (11.4 MByte [http://vision.eng.shu.ac.uk/jan/interactive.avi video])]]||[[Image:Slides.jpg|thumb|160px|Short interactive slides presentation with the system (6.3 MByte [http://vision.eng.shu.ac.uk/jan/slides.avi video])]]||[[Image:Minigolf.jpg|thumb|160px|Browsing the file-system and trying to play minigolf (14.4 MByte [http://vision.eng.shu.ac.uk/jan/minigolf.avi video])]]
 +
|-
 +
|[[Image:Reversi.jpg|thumb| Playing Reversi against the computer (5.54 MByte [http://vision.eng.shu.ac.uk/jan/reversi.avi video] also available at [http://video.google.co.uk/videoplay?docid=4201589281466176805 video.google.co.uk])]]||[[Image:Calibrate Screen.gif|thumb|160px|Calibration of the screen using projected patterns]]||[[Image:Interactive2.jpg|thumb|160px|Prototype of early user-interface (13.7 MByte [http://vision.eng.shu.ac.uk/jan/interactive2.avi video])]]||[[Image:MandoWizard.jpg|thumb|160px|Screenshot of the wizard for configuring the recognition algorithm]]||
 +
|-
 +
|}
  
 
=See Also=
 
=See Also=

Revision as of 14:27, 21 October 2006

Accessing the KDE-menu using the system (2.72 MByte video)
Developed by Juan Roldan, ERASMUS exchange student from Cordoba, Spain
Ushakiran Soutapalli, MSc student at Sheffield Hallam worked on the graphical user-interface

Contents

Camera-Projector System

Application

A software for camera-projector interaction was developed by Juan Roldan, Ushakiran Soutapalli, Julien Faucher, and Jan Wedekind at the Microsystem & Machine Vision Laboratory (MMVL) at Sheffield Hallam University, UK.

The software makes use of a low cost off-the shelf webcam that is calibrated against a standard projector screen. The webcam is used to determine the position of physical pointer (e.g. a pen) which is then used to virtually move the X11 pointer. Point-and-click functionality has also been implemented.

The vision system uses the Mimas real-time computer vision toolkit developed by the MMVL.

How it works

Detection

The detection is a simple colour-segmentation using a thresholded colour-histogram. Therefore you need to use a marker pen or some other object with a distinct colour. The colour should not appear on the screen itself. If the colour of the pen will change due to different illumination conditions, you need to capture these colours when taking the reference image.

Mouse clicks

The standard deviation of a few recent mouse-positions is used as a criterion, wether the mouse is stationary or moving. If the mouse is stationary, a mouse click is issued.

Design

UML-diagram of static structure
UML-diagram showing collaboration of classes

Changelog

2006-10-20 Jan Wedekind 0.6

  • Minor fixes on configure-script

2006-10-20 Jan Wedekind 0.5

  • Fixed the check for gfortran (using AC_PROG_FC now). Thanks to Steven G. Johnson!
# On the older Mandriva version you may have to configure using
./configure FLIBS="-lgfortran"
# On openSuSE 10.0 libgfortranbegin.a was compiled without "-fPIC". You need to configure using
./configure F77=gfortran FLIBS="-lgfortran"

2006-10-17 Jan Wedekind 0.4

  • Added support for UYVY-cameras.

2006-10-16 Jan Wedekind 0.3

  • Video display can be zoomed using the mouse-wheel.
  • Display error-messages when accessing camera fails.

2006-10-13 Jan Wedekind 0.2

  • Removed dependency on ImageMagick.

Downloads

New.gif Download mando-0.6.tar.bz2 (342 kByte). For your convenience the required parts of Mimas are included in the package. To build and run the package do

tar xjf mando-0.6.tar.bz2
cd mando-0.6
./configure
make
./mando

Gallery

Artist's impression of the system
Interactive camera-projector system
Long demonstration of the prototype-system (11.4 MByte video)
Short interactive slides presentation with the system (6.3 MByte video)
Browsing the file-system and trying to play minigolf (14.4 MByte video)
Playing Reversi against the computer (5.54 MByte video also available at video.google.co.uk)
Calibration of the screen using projected patterns
Prototype of early user-interface (13.7 MByte video)
Screenshot of the wizard for configuring the recognition algorithm

See Also

External Links

Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox