Workshop at Euron AGM 2009 (Leuven, Belgium, April 6, 2009)
Organizers
This e-mail address is being protected from spambots. You need JavaScript enabled to view it. This e-mail address is being protected from spambots. You need JavaScript enabled to view it. This e-mail address is being protected from spambots. You need JavaScript enabled to view it.
Motivation
Replication of reported results and their comparison by means of benchmarks are needed to foster a quicker cumulative advancement of our knowledge of intelligent physical agents and even to correctly appreciate disruptive innovation in robotics research.
Should we take inspiration from biology and medicine?
Are replication and benchmarking really possible in robotics?
Are current limits in reporting a bottleneck to industrial exploitation?
Is there an impact on robotics research funding policy evaluation?
Workshop Highlights:
Seminar Format:
This forum was a public discussion of the challenges, problems, possible approaches and doubts raised, related to this program and to identify the possible ways to cope (or fail) with them. The forum consisted of presentations interleaved with a significant amount of additional time for discussions between the presentations and at the end of the half-day single track session.
Post Proceedings:
The speakers and the attendees will be invited to send a 'real' paper AFTER the discussion for a post proceedings book, with no hurry :-)
Program
Chair F Bonsignorio
09:00 - 09:20
Introduction
F. Bonsignorio
09:20 - 9:40
RAWSEEDS: Datasets and Problems for SLAM Benchmarking
M.Matteucci G. Fontana Politecnico di Milano, D.Sorrenti Univ Milano - Bicocca
09:40 - 10:00
Teleworkbench – A Teleoperated Platform for Robotic Experiments
A. Tanoto, U.Witkowski, U. Rückert University of Paderborn
Testing for better design: The case of KRISSALOS Unmanned Surface Vehicle
N. Tsourveloudis, P. Spanoudakis, V. Kanakakis, N. Vitzilaios Technical Univ. of Crete
10:20 - 10:40
Benchmarking vision based outdoor robot localization using both directional and omnidirectional images
E.Frontoni, P. Zingaretti UNIVPM
10:40 - 11:00
Coffee Break
Standardization of service robotics: why, how, when ?
G.Virk Massey University S. Moon Sejong University R.Gelin Aldebaran Robotics
RoSta: Recommendations for Benchmarking in Mobile Service Robotics
K.Pfeiffer Fraunhofer IPA
11:40 - 12:00
In search of good experimental methodologies in robotics: getting inspiration from natural science?
M.Reggiani Uni Padua, F. Amigoni V. Schiafonati Politecnico di Milano
Refutable Robotics Research: what we mean
F. Bonsignorio A. P. Del Pobil John Hallam
12:20 - 13:00
Open Discussion
13:00 - 13:15
Closing