Revision as of 07:46, 5 September 2006

MiCRoN Microscope Vision Software

Implementation

Computer vision for microscopes has to deal with the problem of limited depth of field. But instead of trying to overcome this, one can actually use the depth information concealed in this images to achieve real-time object recognition for microscopes.

Employing algorithms based on sobel edge detection, geometric hashing and based on the bounded hough transform, it was possible to recognise two micro-objects in around 300 milliseconds allowing 4 degrees of freedom and then track them in consecutive frames with rates of up to 15 frames per second!

The software provides a framework to integrate and test different algorithms for recognition and tracking of multiple rigid objects. The parameters are stored in an XML file. The software offers a programmer's application interface, which hides the inherent complexity (black-box principle), so that the vision-system can be integrated easily in a higher level system!

Results

By using focus-stacks as models it was possible to provide real-time object recognition of multiple microscopic objects in up to 4 degrees-of-freedom. The micro-objects are not required to stay at a fixed distance to the camera any more. Novel automated procedures in biology and micro-technology are thus conceivable.

Geometric hashing doesn't perform very well with increasing number of objects. Future work should also be about employing different types of features. Due to real-time constraints the choice is limited however. The tracking algorithm based on the bounded hough transform on the other hand performed very well.

2-D/3 DOF real-time demo on graphical primitives (1.16 MByte video)	2-D/3 DOF penguin live demo (999 kByte video)	Object recognition and tracking of syringe chip in 3-D/4 DOF (16 MByte video)
3-D/4 DOF time lapse video of demo on artificial images (1.53 MByte video)	MiCRoN computer vision poster	Micro-gripper and capacitor with 4 resp. 3 degrees-of-freedom (2.78 MByte video)
Realtime edge detection (3.01 MByte video)	Realtime object recognition and tracking with 3-D/4 DOF (859 kByte video)	Object recognition on a sphere with 3-D/3 DOF (922 kByte video)

Download

Command line of the MiCRoN microscope vision software

You can download the software (GPL license) and some test data to verify the results yourself!

micron-vision-2.0

You first need to install the 4th unofficial release of Mimas-2.0 (28 MByte) of the Mimas Real-Time Computer Vision Library to be able to compile and run micron-vision-2.0 (524 kByte).

Test Data

The online documentation is here and you may also want to download some test data

• Data for test test (1.67 MByte)
• Data for test test2 (1.08 MByte)
• Data for test povray (5.08 MByte)
• Data for test sphere (8.65 MByte)

See Also

• The MiCRoN project
• The Mimas Real-Time Computer Vision Toolkit

External Links

• Online documentation of MiCRoN Microscope Vision Software
• J. Wedekind, M. Boissenin, B.P. Amavasai, F. Caparrelli, J. Travis: Object Recognition and Real-Time Tracking in Microscope Imaging
• N. Leibowitz, Z.Y. Fligelman, R. Nussinov, H.J. Wolfson: Multiple Structural Alignment and Core Detection by Geometric Hashing
• M. A. Greenspan, L. Shang, P. Jasiobedzki: Efficient Tracking with the Bounded Hough Transform