R-, r-, reply- Articles, what are they? Case Studies of Reproducibility and Benchmarking in Robotic Research

Monday, October 14th 2024 2:00 pm to 6:00 pm

Time Presenter Title
14:00
14:10
Welcome Organizers
14:10
14:30
Fabio Bonsignorio, University of Zagreb FER and Heron Robots Reproducibility and Benchmarking in AI and Robotics do matter
14:30
14:50
Pedro Lima, Institute for Systems and Robotics  Benchmarking and competitions
14:50
15:10
Sarah Cosentino, Araya Reproducibility and Benchmarking in Human Robot Interaction
15:10
15:30
Enric Cervera, Universitat Jaume I Software for reproducibility and benchmarking
15:30
16:00
COFFEE BREAK
16:00
16:20
Chinmay V. Samak, Tanmay V. Samak, Venkat N. Krovi, Clemson University F1TENTH Sim Racing League: An Open-Source Competition Framework for Promoting Reproducibility and Benchmarking in Autonomous Driving  
16:20
16:40
Enrica Zereik, CNR-INM  Reproducibility in IEEE RAM  
16:40
17:00
Rahul Mangharam (University of Pennsylvania) and Venkat Krovi (Clemson University) F1tenth and beyond
17:00
17:20
Diego Torricelli, CSIC Eurobench Benchmarking Approach
17:20
17:40
Adam Norton(1), Kostas Bekris(2), Berk Calli(3), Aaron Dollar(4), Yu Sun(5) and Holly Yanco(1); 1 University of Massachusetts Lowell, 2 Rutgers University, 3 Worcester Polytechnic University, 4 Yale University, 5 University of South Florida Collaborative Open-source Manipulation Performance Assessment for Robotics Enhancement (COMPARE) Ecosystem
17:40
18:00
All Discussion
18:00
18:05
Organizers Wrap-up