VIEW-FINDER

(Difference between revisions)
Jump to: navigation, search
m (→Project Partners)
m (→Videos and demonstrations)
Line 198: Line 198:
 
     </div>
 
     </div>
 
</html>
 
</html>
 +
  
 
|<html>  
 
|<html>  
 
       <div style="width:320px;">
 
       <div style="width:320px;">
−
           <object width="320" height="242"><param name="movie" value="http://www.youtube.com/v/hTshC8par98&color1=0xb1b1b1&color2=0xcfcfcf&hl=en_GB&feature=player_embedded&fs=1"></param><param name="allowFullScreen" value="true"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.youtube.com/v/hTshC8par98&color1=0xb1b1b1&color2=0xcfcfcf&hl=en_GB&feature=player_embedded&fs=1" type="application/x-shockwave-flash" allowfullscreen="true" allowScriptAccess="always" width="320" height="242"></embed></object>
+
           <object style="height: 344px; width: 425px"><param name="movie" value="http://www.youtube.com/v/YVj7_yKCznY"><param name="allowFullScreen" value="true"><param name="allowScriptAccess" value="always"><embed src="http://www.youtube.com/v/YVj7_yKCznY" type="application/x-shockwave-flash" allowfullscreen="true" allowScriptAccess="always" width="425" height="344"></object>
 
<div class="thumbcaption" >
 
<div class="thumbcaption" >
 
         Final demonstration for the outdoor scenario: general views and description of the full rescue scenario.
 
         Final demonstration for the outdoor scenario: general views and description of the full rescue scenario.
Line 222: Line 223:
 
| align="right"| coming soon
 
| align="right"| coming soon
 
|}
 
|}
−
 
−
 
−
 
  
 
=See Also=
 
=See Also=

Revision as of 14:45, 19 February 2010

Trials of indoor / outdoor robots at the Royal Military Academy, Belgium: on the foreground the Robudem outdoor robot of partner RMA can be seen and in the background (far-end) the ATRV-Jr iRobot indoor platform (close-ups in next pictures) of partner PIAP can also be seen entering a hangar.
Some of the members of the VF team: pictured here are those present at the final demonstrations and review at SyFire training centre.
Indoor scenario: the ATRV-Jr iRobot platform of partner PIAP with integrated sensors from partners UoR, SHU and IES. The final system employs two processing units (on-board robot PC and dual-core laptop) managing the following sensory information: sonar array, image monocular and pan-tilt camera, tilt and laser range finder, odometry and chemical readings, in semi-autonomous modes (navigation and remote operation). At any given time we have at least 4 streams of wireless transmitted data.
ATRV-Jr of PIAP roaming free in SHU labs; successfull acquisition and communication tests with at least four different streams of data
The View Finder base station as presented at the final review.
Janusz (PIAP) checking remote operation of the robot and image compression / acquisition.
Lazaros (DUTH), Giovanni (IES), Andrea (UoR) and Janusz (PIAP): in preparation for first launch.
George (SHU) and Andrea (UoR) checking SLAM, Laser and tilt processes: acquisition and communication...



Contents

The VIEW-FINDER project

In the event of an emergency, after a fire or other crisis event has occured, a necessary but time consuming pre-requisite, that could delay the real rescue operation, is to establish whether the ground can be accessed / entered safely by human emergency workers. This was the context under which the project was initiated.

Notifications and Announcements

  • Successful completion - 19th Jan 2010: The project was successfully completed. The EU review panel congratulated the project for the integration efforts and the presented overall solution.
  • Advisory: You are advised to visit the official VIEW-FINDER page: "Vision and Chemi-resistor Equipped Web-connected Finding Robots".
  • Disclaimer: In this page you will be viewing pre-dominantly the indoor scenario even though we have tried for most of the information provided herein to be from the project as a whole. To the best of our knowledge the information provided herein are correct at the time of publication.
  • Final dissemination event: IARP workshop RISE 2010 at Sheffield Hallam University on 20-21 January 2010. Further details made available here.


General Description

Viewfinder Logo
EU flagCORDIS logoIST logo

VIEW-FINDER was a field (mobile) robotics project (European-Union, Framework-VI: Project Number 045541), consisting of 9 European partners, that investigated the use of semi-autonomous mobile robot platforms to establish ground safety in the aftermath of fire incidents. The project was coordinated by the Materials and Engineering Research Institute at Sheffield Hallam University and officially ended on 30th November 2009, final review, reports and demos took place on the 18th Jan. 2010. The review that took place on the 19th Jan 2010 judged the project as 'successful with praise on the integration work and overall solution'.

The objective of the VIEW-FINDER project was to develop robots which have the primary task of gathering data to assist the human interveners in taking informed decisions prior to entering either an indoor or outdoor area. Thus the primary aim was to gather data (visual, environmental and chemical) to assist fire rescue personnel after a disaster has occured. A base station combined the gathered information with information retrieved from the large scale GMES-information bases. Issues addressed, related to: 2.5D map building, localisation and reconstruction; interfacing local command information with external sources; autonomous robot navigation and human-robot interfaces (base-station).

Partners PIAP, UoR, SHU and IES were pre-dominantly involved in the indoor scenario and RMA, DUTH predominately involved in the outdoor scenario; with SAS and SyFire being involved in both.


System description

The developed VIEW-FINDER system was a semi-autonomous system; the individual robot-sensors operate autonomously within the limits of the task assigned to them. That is, they autonomously navigate from two assigned points by planning their path and avoid obstacles whilst inspecting the area. Henceforth, the remote central operations control unit assigns tasks to the robots and monitors their execution, with the ability to intervene at any given time. Inasmuch, central operations control has the means to renew task assignments or provide further details on tasks of the ground robot. System-human interactions at the central operations control were facilitated through multi modal interfaces, in which graphical displays play an important but not exclusive role.

Although the robots had the ability to operate autonomously, human operators monitor the robots' processes and send high level task requests, as well as low level commands, through the human-computer interface to some nodes of the ground system. The human-computer interface (base station) had to ensure that a human supervisor and human intervener on the ground, are provided with a reduced yet relevant overview of the area under investigation including the robots and human rescue workers therein.

The project comprised of two scenarios: indoor and outdoor, with a corresponding robot platform for each scenario. The indoor scenario used a heavily modified ATRV junior robot platform that used to be available from iRobot and a purpose built outdoor robot based on the RoboSoft mobile platforms.

The indoor robot was equipped with two laser range finders, one of which was attached to a tilt unit for providing 3D acquisition, a front sonar array, a pan-tilt-zoom camera, a chemical sensor array and a long range wireless communication device. Apart from the existing robot processing unit (Ubuntu 8.04), there were added another two processing units (one with winXP and one with Ubuntu 8.10). The low level control of the robot and behaviour (e.g. obstacle avoidance and navigation) was achieved via the pre-existing processing unit whilst the data processing for the purposes of mapping and localisation were placed on the additional linux unit. The winXP unit was used whenever windows specific (proprietary) software items had to be deployed. All robot collected data were forwarded to an ergonomically designed base station.

The software platform for the indoor robot (both WinXP and Ubuntu 8.10) was a hybrid that used Player 2.1.2 and Corba as the robot hardware communication layer and IES Mailman for wireless data transmission layer (UDP/IP; packing, fragmentation) to the base station. The outdoor robot used solely WinXP and Corba through the RMA partner's modification layer known as Coroba.


Project Partners

Coordinator

  • SHU: Sheffield Hallam University, Materials and Engineering Research Institute (MERI, MMVL), Sheffield, United Kingdom
    • Work predominantly in the indoor scenario (management, integration, mapping, chemical sensors)

Academic Research Partners

  • RMA (Outdoor scenario): Royal Military Academy - Patrimony, Belgium
    • Work predominantly on the outdoor scenario (robot platform, architecture, navigation, localisation)
  • UoR: Sapienza University of Rome, Italy
    • Work predominantly in the indoor scenario (localisation and mapping, communication, integration)

Industrial partners

  • GA: Galileo Avionica -S.P.A., Italy
    • Work predominantly in the indoor scenario (management)

Project outputs and dependencies

Selected Publications

  • G. De Cubber, D. Doroftei, S.A. Berrabah, H. Sahli. Combining Dense structure from Motion and Visual SLAM in a Behavior-based Robot Control Architecture, International journal of Advanced Robotics Systems, March 2010, Vol 6(1).
  • L. Nalpantidis and A. Gasteratos, “Stereo Vision for Robotic Applications in the Presence of Non-ideal Lighting Conditions”, Image and Vision Computing (2010), doi:10.1016/j.imavis.2009.11.011.
  • G. Echeverria and L. Alboul. Shape-preserving mesh simplification based on curvature measures from the Polyhedral Gauss Map, International Journal for Computational Vision and Biomechanics, vol. 1(2), 2009
  • A. Gasteratos, "Active Camera Stabilization with a Fuzzy-grey Controller", European Journal of Mechanical and Environmental Egineering, Vol 2009-2, pp 18-20, 2009.
  • J. Bedkowski, A. Maslowski. NVIDIA CUDA Application in the Cognitive Supervision and Control of the Multi robot System Methodology for the supervision and control of the multi robotic system with CUDA application, Handbook on Emerging sensor and Robotics Technologies for Risky Interventions and Humanitarian de-mining (book series: Mobile Service Robotics, Woodhead Publishing), 2009
  • U. Delprato, M. Cristaldi, G. Tusa. A light-weight communication protocol for tele-operated Robots in risky emergency operations, Handbook ‘Emerging sensor and Robotics Technologies for Risky Interventions and Humanitarian de-mining (book series: Mobile Service Robotics, Woodhead Publishing Company), 2009
  • G. De Cubber, Dense 3D structure and motion estimation as an aid for robot navigation, Journal of Automation, Mobile Robotics & Intelligent Systems, Vol. 2, N° 4, 2008, pp 14-18
  • D. Doroftei, E. Colon, G. De Cubber, A behaviour-based control and software architecture for the visually guided robudem outdoor mobile robot, Journal of Automation, Mobile Robotics & Intelligent Systems, Vol. 2(4), 2008, pp 19-24
  • S. A. Berrabah, E. Colon, Vision – based mobile robot navigation, Journal of Automation, Mobile Robotics & Intelligent Systems, Vol. 2(4), 2008, pp 7-13
  • L. Nalpantidis, G.C. Sirakoulis, and A. Gasteratos. Review of Stereo Vision Algorithms: from Software to Hardware. International Journal of Optomechatronics, 2:435-462, 2008.
  • A. Carbone, A. Finzi, A. Orlandini and F. Pirri (2008). Model-based control architecture for attentive robots in rescue scenarios. Autonomous Robots 24: 87-120
  • L. Alboul, B. Amavasai, G. Chliveros and J. Penders (2007). Mobile robots for information gathering in a large-scale fire incident. IEEE 6th (SMC UK-RI) Conference on Cybernetic Systems (Dublin, Ireland): 122-127
  • A. Carbone and D. Ciacelli and A. Finzi and F. Pirri, Autonomous Attentive Exploration in Search and Rescue Scenarios. Attention in Cognitive Systems. Theories and Systems from an Interdisciplinary Viewpoint 431--446 (2007) http://dx.doi.org/10.1007/978-3-540-77343-6_28


Selected Public Reports

  • coming soon: final report and selected deliverables



Software that has proven useful




Videos and demonstrations

A prototype of the ViewFinder SLAM procedure based on an SIR-RB particle filter implementation: ladar and odometry data collected via the Player software platform.
A video demonstration of the base-station controlling the ATRV-Jr robot through the Human-Machine interface. Different views and control means are shown.
Dissemination of the outdoor trials at the Royal Military Academy outdoor robot (RMA) and Base Station (SAS); a glimpse of the indoor ATRV-jr robot (PIAP) can also be seen.


Final demonstration for the outdoor scenario: general views and description of the full rescue scenario.
Nitrogen gas evolution in a room-fire scenario (simulated with NIST's FDS-SMV); a vertical and horizontal plane are only shown with the fire start indicated by a yellow patch.
coming soon

See Also




Retrieved from "https://vision.eng.shu.ac.uk/mmvl/mmvlwiki/index.php?title=VIEW-FINDER&oldid=3859"
Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox