Microscope Vision Software

From MMVLWiki
(Difference between revisions)
Jump to: navigation, search
m
m
 
(18 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
<html>
 
<html>
   <div class="thumb tright">
+
   <div class="thumb tright"><div style="width:400px;">
    <div style="width:320px;">
+
    <object type="application/x-shockwave-flash" data="http://vision.eng.shu.ac.uk/jan/flv/flvplayer.swf" width="400" height="390">
      <embed style="width:320px; height:320px;" id="VideoPlayback" type="application/x-shockwave-flash"
+
      <param name="flashvars"
        src="http://vision.eng.shu.ac.uk/jan/flv/flvplayer.swf" width="320" height="320" flashvars="file=http://vision.eng.shu.ac.uk/jan/flv/micron.xml&displayheight=240"/>
+
            value="file=http://vision.eng.shu.ac.uk/jan/flv/micron.xml&shuffle=false&repeat=false&searchbar=false&displayheight=300" />
       <div class="thumbcaption" >
+
       <param name="movie" value="http://vision.eng.shu.ac.uk/jan/flv/flvplayer.swf" />
        The software can be configured for a variety of environments
+
      <param name="allowfullscreen" value="true" />
      </div>
+
    </object>
    </div>
+
    <div class="thumbcaption">The software can be configured for a variety of environments</div>
  </div>
+
  </div></div>
 
</html>
 
</html>
 
=MiCRoN Microscope Vision Software=
 
=MiCRoN Microscope Vision Software=
Line 19: Line 19:
  
 
==Results==
 
==Results==
By using focus-stacks as models it was possible to provide '''real-time object recognition of multiple microscopic objects''' in up to 4 degrees-of-freedom. The micro-objects are not required to stay at a fixed distance to the camera any more. Novel automated procedures in biology and micro-technology are thus conceivable.
+
By using focus-stacks as models it was possible to provide '''real-time object recognition of multiple microscopic objects in up to 4 degrees-of-freedom'''. The micro-objects are not required to stay at a fixed distance to the camera any more. Novel automated procedures in biology and micro-technology are thus conceivable.
  
 
'''Geometric hashing''' doesn't perform very well with increasing number of objects. Currently '''RANdom SAmple Consensus''' (RANSAC) is being implemented and different types of features are being investigated. Due to real-time constraints the choice is limited however. The tracking algorithm based on the '''bounded hough transform''' on the other hand performed very well.
 
'''Geometric hashing''' doesn't perform very well with increasing number of objects. Currently '''RANdom SAmple Consensus''' (RANSAC) is being implemented and different types of features are being investigated. Due to real-time constraints the choice is limited however. The tracking algorithm based on the '''bounded hough transform''' on the other hand performed very well.
 +
 +
See [[MiCRoN Microscope Environment|sugar pushing demo]] for more results.
  
 
{|align=center
 
{|align=center
Line 37: Line 39:
 
You can download the software (GPL license) and some test data to verify the results yourself!
 
You can download the software (GPL license) and some test data to verify the results yourself!
 
===micron-vision-2.0===
 
===micron-vision-2.0===
You first need to install the [http://vision.eng.shu.ac.uk/jan/mimas/mimas-2.0unofficial4.tar.bz2 4th unofficial release of Mimas-2.0] (28 MByte) of the [[Mimas|Mimas Real-Time Computer Vision Library]] to be able to compile and run [http://vision.eng.shu.ac.uk/jan/micron-vision/micron-vision-2.0.tar.bz2 micron-vision-2.0] (524 kByte).
+
You first need to install the [http://vision.eng.shu.ac.uk/jan/mimas/ latest unofficial release of Mimas-2.0] (28 MByte) of the [[Mimas|Mimas Real-Time Computer Vision Library]] to be able to compile and run [http://vision.eng.shu.ac.uk/jan/micron-vision/micron-vision-2.0.tar.bz2 micron-vision-2.0] (524 kByte).
  
 
===Test Data===
 
===Test Data===
Line 47: Line 49:
  
 
=See Also=
 
=See Also=
* The [[Micron|MiCRoN project]]
+
* [[Microscope Control Software]]
* The [[Mimas|Mimas Real-Time Computer Vision Toolkit]]
+
 
* [[Microscope Environment]]
 
* [[Microscope Environment]]
 +
* [[Depth from Focus]]
 +
* [[TEM vision software]]
 +
* [[Image:mimasanim.gif|48px]] [[Mimas]]
 +
* [[Image:Hornetseye.png|48px]] [[Hornetseye]]
  
 
=External Links=
 
=External Links=
 
* [http://vision.eng.shu.ac.uk/jan/micron-vision-docs/ Online documentation] of MiCRoN Microscope Vision Software
 
* [http://vision.eng.shu.ac.uk/jan/micron-vision-docs/ Online documentation] of MiCRoN Microscope Vision Software
* [[Image:New.gif]] J. Wedekind, M. Boissenin, B.P. Amavasai, F. Caparrelli, J. Travis: [http://vision.eng.shu.ac.uk/jan/IMVIP_wedekind_CR.pdf Object Recognition and Real-Time Tracking in Microscope Imaging] (also see [http://www.rince.ie/imvip2006/proceedings.html IMVIP2006 proceedings])
+
* J. Wedekind, M. Boissenin, B.P. Amavasai, F. Caparrelli, J. Travis: [http://vision.eng.shu.ac.uk/jan/IMVIP_wedekind_CR.pdf Object Recognition and Real-Time Tracking in Microscope Imaging] (also see [http://elm.eeng.dcu.ie/imvip/proceedings.html IMVIP 2006 proceedings])
 
* N. Leibowitz, Z.Y. Fligelman, R. Nussinov, H.J. Wolfson: [http://www.math.tau.ac.il/~wolfson/papers/ismb99.ps.gz Multiple Structural Alignment and Core Detection by Geometric Hashing]
 
* N. Leibowitz, Z.Y. Fligelman, R. Nussinov, H.J. Wolfson: [http://www.math.tau.ac.il/~wolfson/papers/ismb99.ps.gz Multiple Structural Alignment and Core Detection by Geometric Hashing]
* M. A. Greenspan, L. Shang, P. Jasiobedzki: [http://post.queensu.ca/~greensm/papers/GreShaJas04.pdf Efficient Tracking with the Bounded Hough Transform]
+
* M. A. Greenspan, L. Shang, P. Jasiobedzki: [http://rcvlab.ece.queensu.ca/~greensm/papers/GreShaJas04.pdf Efficient Tracking with the Bounded Hough Transform]
 +
 
 +
{{Addthis}}
  
 
[[Category:Projects]]
 
[[Category:Projects]]
 
[[Category:Micron]]
 
[[Category:Micron]]

Latest revision as of 14:50, 26 May 2010

The software can be configured for a variety of environments

Contents

[edit] MiCRoN Microscope Vision Software

[edit] Implementation

Computer vision for microscopes has to deal with the problem of limited depth of field. But instead of trying to overcome this, one can actually use the depth information concealed in this images to achieve real-time object recognition for microscopes.

Employing sobel edge detection, geometric hashing and the bounded hough transform it was possible to recognise two micro-objects in around 300 milliseconds allowing 4 degrees of freedom and then track them in consecutive frames with rates of 15 frames per second!

The software provides a framework to integrate and test different algorithms for recognition and tracking of multiple rigid objects. The parameters are stored in an XML file. The software offers a programmer's application interface, which hides the inherent complexity (black-box principle), so that the vision-system can be integrated easily in a higher level system!

[edit] Results

By using focus-stacks as models it was possible to provide real-time object recognition of multiple microscopic objects in up to 4 degrees-of-freedom. The micro-objects are not required to stay at a fixed distance to the camera any more. Novel automated procedures in biology and micro-technology are thus conceivable.

Geometric hashing doesn't perform very well with increasing number of objects. Currently RANdom SAmple Consensus (RANSAC) is being implemented and different types of features are being investigated. Due to real-time constraints the choice is limited however. The tracking algorithm based on the bounded hough transform on the other hand performed very well.

See sugar pushing demo for more results.

2-D/3 DOF real-time demo on graphical primitives (1.16 MByte video)
2-D/3 DOF penguin live demo (999 kByte video)
Object recognition and tracking of syringe chip in 3-D/4 DOF (16 MByte video)
3-D/4 DOF time lapse video of demo on artificial images (1.53 MByte video)
MiCRoN computer vision poster
Micro-gripper and capacitor with 4 resp. 3 degrees-of-freedom (2.78 MByte video)
Realtime edge detection (3.01 MByte video)
Realtime object recognition and tracking with 3-D/4 DOF (859 kByte video)
Object recognition on a sphere with 3-D/3 DOF (922 kByte video)
Object recognition to locate intersection of pipette with focussed plane (2.25 MByte video)
Illustration of Geometric Hashing with 3 degrees-of-freedom

[edit] Download

Command line of the MiCRoN microscope vision software

You can download the software (GPL license) and some test data to verify the results yourself!

[edit] micron-vision-2.0

You first need to install the latest unofficial release of Mimas-2.0 (28 MByte) of the Mimas Real-Time Computer Vision Library to be able to compile and run micron-vision-2.0 (524 kByte).

[edit] Test Data

The online documentation is here and you may also want to download some test data

[edit] See Also

[edit] External Links

Bookmark and Share

Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox