The performance of a software component implementing a robotic functionality depends on many factors ranging from the system configuration (e.g., available sensors and robot kinematics) to the operating environment, passing by the component configuration parameters. A naive approach to model the performance of such a software component is to measure its performance on every possible combination of such variables. However, this is not possible as the number of combinations would not be tractable, considering also that multiple measurements should be performed for each of them. To make the problem tractable we propose to sample a relatively small number of combinations, conduct experiments for each of them, and from these results estimate a statistical model of the software component performance which we call component performance model. A performance model allows comparison of different components implementing the same functionality to determine the best one to be used in a given setting and its optimal configuration. Moreover, performance models of multiple functionalities may be composed to predict the performance of an entire system at design-time. Besides the general framework to extract performance models here we present an operational use case in Simultaneous Localization and Mapping (SLAM).

Performance Models in Robotics with a Use Case on SLAM

Piazza E.;Matteucci M.;
2022-01-01

Abstract

The performance of a software component implementing a robotic functionality depends on many factors ranging from the system configuration (e.g., available sensors and robot kinematics) to the operating environment, passing by the component configuration parameters. A naive approach to model the performance of such a software component is to measure its performance on every possible combination of such variables. However, this is not possible as the number of combinations would not be tractable, considering also that multiple measurements should be performed for each of them. To make the problem tractable we propose to sample a relatively small number of combinations, conduct experiments for each of them, and from these results estimate a statistical model of the software component performance which we call component performance model. A performance model allows comparison of different components implementing the same functionality to determine the best one to be used in a given setting and its optimal configuration. Moreover, performance models of multiple functionalities may be composed to predict the performance of an entire system at design-time. Besides the general framework to extract performance models here we present an operational use case in Simultaneous Localization and Mapping (SLAM).
2022
Benchmark testing
Measurement
Performance Evaluation and Benchmarking
Predictive models
Robots
Sensor phenomena and characterization
Simultaneous localization and mapping
Software
Software Tools for Benchmarking and Reproducibility
File in questo prodotto:
File Dimensione Formato  
Performance_Models_in_Robotics_With_a_Use_Case_on_SLAM_IEEE_RAL_published.pdf

Accesso riservato

Descrizione: Articolo pubblicato
: Publisher’s version
Dimensione 1.52 MB
Formato Adobe PDF
1.52 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1202341
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
social impact