This page lists events of interest about Good Experimental Methodology and Benchmarking in Robotics.
It is maintained by the EURON GEM SIG.

If you want that your event appears on this page ...pls contact
This e-mail address is being protected from spambots. You need JavaScript enabled to view it. or This e-mail address is being protected from spambots. You need JavaScript enabled to view it. or This e-mail address is being protected from spambots. You need JavaScript enabled to view it.

Upcoming events

• Prague Online - October 1 , 2021

  Workshop on Reproducible Research, Performance Evaluation and Benchmarking in Intelligent Robotics: State of the Art   at Iros 2021 in Prague, Czech Republic  (from September 27 to October 1), October 1, 2021, Full Day, check Iros website and here for the details…

Recent past events

• Montreal - May 23, 2019

  Workshop on Taking Reproducible Research in Robotics to the Mainstream: Building on the IEEE RAM R-Articles  at ICRA 2019 in Montreal (from May 20 to May 24), 2019 (Full Day)…

• Bucharest - March 20, 2019

  Workshop on Reproducible Robotics: 10 years later at ERF 2019 in Bucharest on  March 20th, 2019…

• Macau - November 4 to 8, 2019

  Workshop on Reproducibility of Research, Benchmarking and Verification of Autonomous Robotic Systems at Iros 2019 in Macau, China (from November 4 to November 8), 2019 (Full Day)…

• Brisbane - May 21, 2018

  Workshop on Reproducible Research in Robotics: the IEEE Robotics &Automation Magazine R-papers  at ICRA 2018 in Brisbane (Australia)  on May 21st, 2018…

• Tampere - March 13, 2018

  Workshop on Research Reproducibility and Benchmarking in Robotics at ERF 2018 in Tampere on  March 13th, 2018…

• Singapore - May 29, 2017

  Workshop on Reproducible Research in Robotics: Current Status and Road Ahead at ICRA 2017 in Singapore on May 29th, 2017 (Full Day)…

• Ljubljana, Slovenia - March 23, 2016

  Workshop on Recent progress in Research Reproducibility in Robotics: A critical enabler of research exploitation at ERF2016 (Ljubljana, Slovenia, March 23, 2016)…

• Hamburg, Germany - September 28, 2015

  Open forum on evaluation of results, replication of experiments and benchmarking in roboticsresearch at IROS 2015 (Hamburg, Germany - September 28, 2015)…

• Hong Kong, China - June 5, 2014 (PM)

  Workshop on Epistemological issues in robotics research and research result evaluation research at ICRA 2014 (Hong Kong, China - June 5, 2014)…

• Tokyo, Japan - November 7, 2013

  Workshop on Metrics of Embodied Learning Processes in Robots and Animals at IROS 2013  (Tokyo, Japan - November 7, 2013, PM)…

• Berlin, Germany - June, 27, 2013

  Proposals for Experimental Protocols for Robotics Research during the RSS 2013 conference  (Berlin, Germany, June 27, 2013)…

• Vilamoura, Algarve, Portugal - October 12, 2012

  Workshop on Metrics of sensory motor integration in robots and animals at IROS 2012  (Vilamoura, Algarve, Portugal - October 12, 2012)…

• Lyon, France - March, 21, 2013

  Replicable Robotics Research, Benchmarking and Result Exploitation: where we are  during the European Robotics Forum (Lyon, France, March 21, 2013)…

• Sydney, NSW, Australia - July 12, 2012

  From theory to practice of performance comparison and result replications in Robotics Research - Workshop at RSS 2012 (Sydney, NSW, Australia - July 12, 2012)  …

• St. Paul, Minnesota, USA - May 18, 2012

  Workshop on the Conditions for Replicable Experiments and Performance Comparison in Robotics Research at ICRA 2012 (St. Paul, Minnesota, USA - May 18, 2012)  …

• College Park , MD, USA - 20-22 March, 2012

  PerMIS'12 Performance Metrics for Intelligent Systems Workshop (Baltimore, USA, 20-22 March, 2012)…

• Shanghai, China - May 13, 2011

  Workshop on the path Towards Replicable Experiments in Robotics Research - ICRA 2011 at IEEE ICRA 2011 (Shanghai, China, May 13, 2011)…

• Vasteras, Sweden - April 8, 2011

  EuCogII-Euron Workshop: Challenges, GEM & Benchmarking in Cognitive Systems and Robotics during the European Robotics Forum (Vasteras, Sweden, April 8, 2011)…

• Bielefeld, Germany - February 7-8, 2011

  Excellence Cluster Cognitive Interaction Technology (CITEC) at Bielefeld University Workshop on Benchmarking and Evaluation of Interactive Cognitive Systems (Bielefeld, Germany, February 7-8, 2011)…

• Rapperswil, Switzerland - January 28-30, 2011

  EuCogII Workshop on Challenges for Cognitive Systems (Rapperswil, Switzerland, January 28-30, 2011)…

• Taipei, Taiwan - October 22, 2010

  IEEE/RSJ IROS 2010 Workshop on Performance Evaluation and Benchmarking for Intelligent Robots and Systems with Cognitive and Autonomy Capabilities (Taipei, Taiwan, October 22, 2010)…

• Baltimore, USA - 28-30 September, 2010

  PerMIS'10 Performance Metrics for Intelligent Systems Workshop (Baltimore, USA, 28-30 September, 2010)…

• Zaragoza,Spain - June 28, 2010

  Workshop on Good Experimental Methodology in Robotics and Replicable Robotics Research at RSS'10 (Zaragoza,Spain, June 28, 2010)…

• Anchorage, Alaska, USA - May 3-8, 2010

  Workshop on The Role of Experiments in Robotics Research at IEEE ICRA 2010 (Anchorage, Alaska, USA, May 3-8, 2010)…

• Donostia-S.Sebastian, Spain - 10-12 March, 2010

  Workshop on Good Experimental Methodology and Benchmarking in Robotics Research and Applications - GEMBENCH10 at the Euron Annual General Meeting (Donostia-S.Sebastian, Spain, 10-12 March, 2010) colocated with the Europ Annual General Meeting program and downloadable presentations can be found here.…

• St. Louis, MO, USA - October 15, 2009

  IEEE/RSJ IROS 2009 Workshop on Performance Evaluation and Benchmarking for NEXT Intelligent Robots and Systems (St. Louis, MO, USA, October 15, 2009)…

• NIST Gaithersburg, USA - 21-23 September, 2009

  PerMIS'09 Performance Metrics for Intelligent Systems Workshop (NIST Gaithersburg, USA, 21-23 September, 2009)…

• Seattle,WA, USA - June 28, 2009

  Workshop on Good Experimental Methodology in Robotics at RSS'09 (Seattle,WA, USA, June 28, 2009)…

• Leuven, Belgium - 6-8 April, 2009

  Workshop on Good Experimental Methodology and Benchmarking in Robotics Research and Applications - GEMBENCH09 at the Euron Annual General Meeting (Leuven, Belgium, 6-8 April, 2009)…

• Nice, France - 26 September, 2008

  IEEE/RSJ IROS 2008 Workshop on Performance Evaluation and Benchmarking for Intelligent Robots and Systems (Nice, France, 26 September, 2008), check the program…

• Coimbra, Portugal - 8-10 September, 2008

  Clawar 2008 Session on Benchmarking and standardization for clawar and mobile robots (Coimbra, Portugal, 8-10 September, 2008)…

• NIST Gaithersburg, USA, 19-21 August, 2008

  PerMIS'08 Performance Metrics for Intelligent Systems Workshop (NIST Gaithersburg, USA, 19-21 August, 2008)…

• Zurich, Switzerland, June 28, 2008

  Workshop on Experimental Methodology and Benchmarking in Robotics Research at RSS'08 (Zurich, Switzerland, June 28, 2008)…

• Karlsruhe, Germany, April 1, 2008

  CogGemBench 2008 (Karlsruhe, Germany, April 1, 2008)…

• Prague, Czech Republic, March 25-26, 2008

  GEMBenchForum 2008 (Prague, Czech Republic, March 25-26, 2008)…

• San Diego, USA, November 2, 2007

  IEEE/RSJ IROS 2007 Workshop on Performance Evaluation and Benchmarking for Intelligent Robots and Systems  (San Diego, USA, November 2, 2007)…

• Beijing, China, October 10, 2006

  IEEE/RJS IROS Workshop on Benchmarks in Research  (Beijing, China, October 10, 2006)…