This letter presents an Approximate Dynamic Programming (ADP) least-squares based approach for solving optimal stopping problems with a large state space. By extending some previous work in the area of optimal stopping problems, it provides a framework for their formulation and resolution. The proposed method uses a combined on/off policy exploration mechanism, where states are generated by means of state transition probability distributions different from the ones dictated by the underlying Markov decision processes. The contraction mapping property of the associated projected Bellman operator is analysed as well as the convergence of the resulting algorithm.

Enhanced Exploration Least-Squares Methods for Optimal Stopping Problems / Forootani, A.; Tipaldi, M.; Iervolino, R.; Dey, S.. - In: IEEE CONTROL SYSTEMS LETTERS. - ISSN 2475-1456. - 6:(2022), pp. 271-276. [10.1109/LCSYS.2021.3069708]

Enhanced Exploration Least-Squares Methods for Optimal Stopping Problems

Iervolino R.
Penultimo
Membro del Collaboration Group
;
2022

Abstract

This letter presents an Approximate Dynamic Programming (ADP) least-squares based approach for solving optimal stopping problems with a large state space. By extending some previous work in the area of optimal stopping problems, it provides a framework for their formulation and resolution. The proposed method uses a combined on/off policy exploration mechanism, where states are generated by means of state transition probability distributions different from the ones dictated by the underlying Markov decision processes. The contraction mapping property of the associated projected Bellman operator is analysed as well as the convergence of the resulting algorithm.
2022
Enhanced Exploration Least-Squares Methods for Optimal Stopping Problems / Forootani, A.; Tipaldi, M.; Iervolino, R.; Dey, S.. - In: IEEE CONTROL SYSTEMS LETTERS. - ISSN 2475-1456. - 6:(2022), pp. 271-276. [10.1109/LCSYS.2021.3069708]
File in questo prodotto:
File Dimensione Formato  
Enhanced_Exploration_Least-Squares_Methods_for_Optimal_Stopping_Problems.pdf

solo utenti autorizzati

Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 380.71 kB
Formato Adobe PDF
380.71 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/899405
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact