In this paper, we consider the problem of designing a feedback policy for a discrete time stochastic hybrid system that should be kept operating within some compact set A. To this purpose, we introduce an infinite-horizon discounted average reward function, where a negative reward is associated to the transitions driving the system outside A and a positive reward to those leading it back to A. The idea is that the stationary policy maximizing this reward function will keep the system within A as long as possible, and, if the system happens to exit A, it will bring it back to A as soon as possible, compatibly with the system dynamics. This self recovery approach is particularly useful in those cases where it is not possible to maintain the system within A indefinitely. The performance of the resulting strategy is assessed on a benchmark example.

A self-recovery approach to the probabilistic invariance problem for stochastic hybrid systems

PRANDINI, MARIA;PIRODDI, LUIGI
2012

Abstract

In this paper, we consider the problem of designing a feedback policy for a discrete time stochastic hybrid system that should be kept operating within some compact set A. To this purpose, we introduce an infinite-horizon discounted average reward function, where a negative reward is associated to the transitions driving the system outside A and a positive reward to those leading it back to A. The idea is that the stationary policy maximizing this reward function will keep the system within A as long as possible, and, if the system happens to exit A, it will bring it back to A as soon as possible, compatibly with the system dynamics. This self recovery approach is particularly useful in those cases where it is not possible to maintain the system within A indefinitely. The performance of the resulting strategy is assessed on a benchmark example.
Proceedings of the 51st IEEE Conference on Decision and Control
978-1-4673-2065-8
AUT
File in questo prodotto:
File Dimensione Formato  
2012 - CDC - PrandiniPiroddi.pdf

Accesso riservato

: Post-Print (DRAFT o Author’s Accepted Manuscript-AAM)
Dimensione 625.06 kB
Formato Adobe PDF
625.06 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11311/674145
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 1
social impact