Revision as of 13:00, 27 July 2009

MiCRoN Microscope Vision Software

Implementation

Computer vision for microscopes has to deal with the problem of limited depth of field. But instead of trying to overcome this, one can actually use the depth information concealed in this images to achieve real-time object recognition for microscopes.

Employing sobel edge detection, geometric hashing and the bounded hough transform it was possible to recognise two micro-objects in around 300 milliseconds allowing 4 degrees of freedom and then track them in consecutive frames with rates of 15 frames per second!

The software provides a framework to integrate and test different algorithms for recognition and tracking of multiple rigid objects. The parameters are stored in an XML file. The software offers a programmer's application interface, which hides the inherent complexity (black-box principle), so that the vision-system can be integrated easily in a higher level system!

Results

By using focus-stacks as models it was possible to provide real-time object recognition of multiple microscopic objects in up to 4 degrees-of-freedom. The micro-objects are not required to stay at a fixed distance to the camera any more. Novel automated procedures in biology and micro-technology are thus conceivable.

Geometric hashing doesn't perform very well with increasing number of objects. Currently RANdom SAmple Consensus (RANSAC) is being implemented and different types of features are being investigated. Due to real-time constraints the choice is limited however. The tracking algorithm based on the bounded hough transform on the other hand performed very well.

See sugar pushing demo for more results.

2-D/3 DOF real-time demo on graphical primitives (1.16 MByte video)	2-D/3 DOF penguin live demo (999 kByte video)	Object recognition and tracking of syringe chip in 3-D/4 DOF (16 MByte video)	3-D/4 DOF time lapse video of demo on artificial images (1.53 MByte video)
MiCRoN computer vision poster	Micro-gripper and capacitor with 4 resp. 3 degrees-of-freedom (2.78 MByte video)	Realtime edge detection (3.01 MByte video)	Realtime object recognition and tracking with 3-D/4 DOF (859 kByte video)
Object recognition on a sphere with 3-D/3 DOF (922 kByte video)	Object recognition to locate intersection of pipette with focussed plane (2.25 MByte video)	Illustration of Geometric Hashing with 3 degrees-of-freedom

Download

Command line of the MiCRoN microscope vision software

You can download the software (GPL license) and some test data to verify the results yourself!

micron-vision-2.0

You first need to install the 4th unofficial release of Mimas-2.0 (28 MByte) of the Mimas Real-Time Computer Vision Library to be able to compile and run micron-vision-2.0 (524 kByte).

Test Data

The online documentation is here and you may also want to download some test data

• Data for test test (1.67 MByte)
• Data for test test2 (1.08 MByte)
• Data for test povray (5.08 MByte)
• Data for test sphere (8.65 MByte)

See Also

• Microscope Control Software
• Microscope Environment
• Depth from Focus
• TEM vision software
• Mimas
• Hornetseye

External Links

• Online documentation of MiCRoN Microscope Vision Software
• J. Wedekind, M. Boissenin, B.P. Amavasai, F. Caparrelli, J. Travis: Object Recognition and Real-Time Tracking in Microscope Imaging (also see IMVIP 2006 proceedings)
• N. Leibowitz, Z.Y. Fligelman, R. Nussinov, H.J. Wolfson: Multiple Structural Alignment and Core Detection by Geometric Hashing
• M. A. Greenspan, L. Shang, P. Jasiobedzki: Efficient Tracking with the Bounded Hough Transform