VIEW-FINDER

From MMVLWiki
Revision as of 11:57, 25 August 2010 by G.chliveros@shu.ac.uk (Talk | contribs)
Jump to: navigation, search
Trials of indoor / outdoor robots at the Royal Military Academy, Belgium (Dec. 2009): on the foreground the Robudem outdoor robot of partner RMA can be seen and in the background (far-end) the ATRV-Jr iRobot indoor platform (close-ups in next pictures) of partner PIAP can also be seen entering a hangar.
Indoor scenario: the ATRV-Jr iRobot platform of partner PIAP with integrated sensors from partners UoR, SHU and IES. The final system employs two processing units (on-board robot PC and dual-core laptop) managing the following sensory information: sonar array, image monocular and pan-tilt camera, tilt and laser range finder, odometry and chemical readings, in semi-autonomous modes (navigation and remote operation). At any given time we had at least 4 streams of wireless transmitted data.
Some of the members of the VF team: pictured here are those present at the final demonstrations (Jan. 2010) and review at SyFire training centre.
ATRV-Jr of PIAP roaming free in SHU labs (Oct 2009); successful acquisition and communication tests with at least four different streams of data
The View Finder base station as presented at the final review (Jan 2010).
Janusz (PIAP) checking remote operation of the robot and image compression / acquisition (Oct 2009).
Lazaros (DUTH), Giovanni (IES), Andrea (UoR) and Janusz (PIAP): in preparation for first integrated test launch (Oct 2009).
George (SHU) and Andrea (UoR) checking SLAM, Laser and tilt processes: acquisition and communication...
Project coordinator Dr J. Penders at SyFire test and trials (Oct 2009).



Contents

The VIEW-FINDER project

In the event of an emergency, after a fire or other crisis event has occured, a necessary but time consuming pre-requisite, that could delay the real rescue operation, is to establish whether the ground can be accessed / entered safely by human emergency workers. This was the context under which the project was initiated. The final project report is available here.


  • Disclaimer: In this page you will be viewing pre-dominantly the indoor scenario even though we have tried for most of the information provided herein to be from the project as a whole. To the best of our knowledge the information provided herein are correct at the time of publication. However, the views or claims expressed in external links provided herein are not directly endorsed by Sheffield Hallam University. If you find any mistakes or omission please contact MMVL (details at the main MMVL wiki-page).


  • Advisory: You are advised to visit the official VIEW-FINDER page: "Vision and Chemi-resistor Equipped Web-connected Finding Robots".



Notifications and Announcements

  • Final project report - 15 July, 2010: the final project report, amended and updated, is available here.
  • Successful completion - 05 July, 2010: According to the European Union panel's Review Report the project contribution is 'sufficient' and the overall testing, experimentation and results dissemination are 'good'. The works on depth recovery and point-cloud rendering were deemed to be 'promising' and 'novel', though 'ongoing'. Minor changes on the final report were recommended.
  • Successful demonstrations - 19th Jan 2010: The project demonstrations were deemed 'sufficient' and overall 'successful'. The EU review panel congratulated the project integration efforts and the presented solution.
  • Final dissemination event: IARP workshop RISE 2010 at Sheffield Hallam University on 20-21 January 2010.


General Description

Viewfinder Logo
EU flagCORDIS logoIST logo

VIEW-FINDER was a field (mobile) robotics project (European-Union, Framework-VI: Project Number 045541), consisting of 9 European partners, that investigated the use of semi-autonomous mobile robot platforms to establish ground safety in the aftermath of fire incidents. The project was coordinated by the Materials and Engineering Research Institute at Sheffield Hallam University and officially ended on 30th November 2009, final review, reports and demos took place on the 18th Jan. 2010. The review that took place on the 19th Jan 2010 judged the project as 'successful'.

The objective of the VIEW-FINDER project was to develop robots which have the primary task of gathering data to assist the human interveners in taking informed decisions prior to entering either an indoor or outdoor area. Thus the primary aim was to gather data (visual, environmental and chemical) to assist fire rescue personnel after a disaster has occured. A base station combined the gathered information with information retrieved from the large scale GMES-information bases. Issues addressed, related to: 2.5D map building, localisation and reconstruction; interfacing local command information with external sources; autonomous robot navigation and human-robot interfaces (base-station).

Partners PIAP, UoR, SHU and IES were pre-dominantly involved in the indoor scenario and RMA, DUTH predominately involved in the outdoor scenario; with SAS and SyFire being involved in both.


System description

The developed VIEW-FINDER system was a semi-autonomous system; the individual robot-sensors operate autonomously within the limits of the task assigned to them. That is, they autonomously navigate from two assigned points by planning their path and avoid obstacles whilst inspecting the area. Henceforth, the remote central operations control unit assigns tasks to the robots and monitors their execution, with the ability to intervene at any given time. Inasmuch, central operations control has the means to renew task assignments or provide further details on tasks of the ground robot. System-human interactions at the central operations control were facilitated through multi modal interfaces, in which graphical displays play an important but not exclusive role.

Although the robots had the ability to operate autonomously, human operators monitor the robots' processes and send high level task requests, as well as low level commands, through the human-computer interface to some nodes of the ground system. The human-computer interface (base station) had to ensure that a human supervisor and human intervener on the ground, are provided with a reduced yet relevant overview of the area under investigation including the robots and human rescue workers therein.

The project comprised of two scenarios: indoor and outdoor, with a corresponding robot platform for each scenario. The indoor scenario used a heavily modified ATRV junior robot platform that used to be available from iRobot and a purpose built outdoor robot based on the RoboSoft mobile platforms.

The indoor robot was equipped with two laser range finders, one of which was attached to a tilt unit for providing 3D acquisition, a front sonar array, a pan-tilt-zoom camera, a chemical sensor array and a long range wireless communication device. Apart from the existing robot processing unit (Ubuntu 8.04), there were added another two processing units (one with winXP and one with Ubuntu 8.10). The low level control of the robot and behaviour (e.g. obstacle avoidance and navigation) was achieved via the pre-existing processing unit whilst the data processing for the purposes of mapping and localisation were placed on the additional linux unit. The winXP unit was used whenever windows specific (proprietary) software items had to be deployed. All robot collected data were forwarded to an ergonomically designed base station.

The software platform for the robots was as follows:

  • indoor robot (both WinXP and Ubuntu 8.10) was a hybrid that used Player 2.1.2 and Corba as the robot hardware communication layer and IES Mailman for wireless data transmission layer (UDP/IP; packing, fragmentation) to the base station
  • outdoor robot used solely WinXP and Corba through the RMA partner's modification layer known as Coroba

In both cases, great effort was dedicated on the integration of hardware and software modules.


Project Partners

Coordinator

  • SHU: Sheffield Hallam University, Materials and Engineering Research Institute (MERI, MMVL), Sheffield, United Kingdom
    • Work predominantly in the indoor scenario (management, integration, mapping, chemical sensors)

Academic Research Partners

  • RMA (Outdoor scenario): Royal Military Academy - Patrimony, Belgium
    • Work predominantly on the outdoor scenario (robot platform, architecture, navigation, localisation)
  • UoR: Sapienza University of Rome, Italy
    • Work predominantly in the indoor scenario (localisation and mapping, communication, integration)

Industrial partners

  • GA: Galileo Avionica -S.P.A., Italy
    • Work predominantly in the indoor scenario (management)


<!>

Project outputs and dependencies

  • Project deliverables are available here; public deliverables can be accessed therein.


Selected Publications

  • L. Alboul and G. Chliveros (2010). A System for Reconstruction from Point Clouds in 3D: Simplification and Mesh Representation, Proceedings of the International Conference on Control, Automation, Robotics and Vision (ICARCV 2010), Dec 2010 Singapore.
  • G. De Cubber, D. Doroftei, S.A. Berrabah and H. Sahli (2010). Combining Dense structure from Motion and Visual SLAM in a Behavior-based Robot Control Architecture, International Journal of Advanced Robotics Systems 6(1): 11-23.
  • L. Nalpantidis and A. Gasteratos (2010). Stereo vision for robotic applications in the presence of non-ideal lighting conditions, Image and Vision Computing 28: 940-951.
  • L. Nalpantidis and A. Gasteratos(2010). Biologically and Psychophysically Inspired Adaptive Support Weights Algorithm for Stereo Correspondence, Robotics and Autonomous Systems 58: 457-464.
  • G. Echeverria and L. Alboul (2009). Shape-preserving mesh simplification based on curvature measures from the Polyhedral Gauss Map, International Journal for Computational Vision and Biomechanics 1(2): 55-68
  • J. Bedkowski and A. Maslowski (2009). NVIDIA CUDA Application in the Cognitive Supervision and Control of the Multi robot System Methodology for the supervision and control of the multi robotic system with CUDA application, Handbook on Emerging sensor and Robotics Technologies for Risky Interventions and Humanitarian de-mining (book series: Mobile Service Robotics, Woodhead Publishing).
  • U. Delprato, M. Cristaldi and G. Tusa (2009). A light-weight communication protocol for tele-operated Robots in risky emergency operations, Handbook ‘Emerging sensor and Robotics Technologies for Risky Interventions and Humanitarian de-mining (book series: Mobile Service Robotics, Woodhead Publishing Company).
  • G. De Cubber (2008), Dense 3D structure and motion estimation as an aid for robot navigation, Journal of Automation, Mobile Robotics & Intelligent Systems 2(4): 14-18
  • D. Doroftei, E. Colon and G. De Cubber (2008), A behaviour-based control and software architecture for the visually guided robudem outdoor mobile robot, Journal of Automation, Mobile Robotics & Intelligent Systems, 2(4): 19-24
  • S. A. Berrabah and E. Colon (2008). Vision – based mobile robot navigation, Journal of Automation, Mobile Robotics & Intelligent Systems, 2(4): 7-13
  • A. Carbone, A. Finzi, A. Orlandini and F. Pirri (2008). Model-based control architecture for attentive robots in rescue scenarios. Autonomous Robots 24: 87-120
  • L. Alboul, B. Amavasai, G. Chliveros and J. Penders (2007). Mobile robots for information gathering in a large-scale fire incident. IEEE 6th (SMC UK-RI) Conference on Cybernetic Systems (Dublin, Ireland): 122-127.
  • A. Carbone, D. Ciacelli, A. Finzi and F. Pirri (2007). Autonomous Attentive Exploration in Search and Rescue Scenarios. In: Attention in Cognitive Systems; theories and systems from an interdisciplinary viewpoint, pp. 431 - 446


Software that has proven useful



Videos and demonstrations

A prototype of the ViewFinder SLAM procedure based on an SIR-RB particle filter implementation: ladar and odometry data collected via the Player software platform.
A video demonstration of the base-station controlling the ATRV-Jr robot through the Human-Machine interface. Different views and control means are shown.
coming soon


Final demonstration for the outdoor scenario: general views and description of the full rescue scenario. A glimpse of the indoor ATRV-jr robot (PIAP) can also be seen.
Nitrogen gas evolution in a room-fire scenario (simulated with NIST's FDS-SMV); a vertical and horizontal plane are only shown with the fire start indicated by a yellow patch.
coming soon


See Also




Retrieved from "https://vision.eng.shu.ac.uk/mmvl/mmvlwiki/index.php?title=VIEW-FINDER&oldid=4339"
Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox