Assessing reliability of software programs during validation is a challenging task for engineers. The assessment is not only required to be unbiased, but it needs to provide tight variance (hence, tight confidence interval) with as few test cases as possible. Statistical sampling is a theoretically sound approach for reliability testing, but it is often impractical in its current form, because of too many test cases required to achieve desired confidence levels, especially when the software has few residual faults inside. We claim that the potential of statistical sampling methods is largely underestimated. This paper presents an adaptive sampling-based testing (AST) strategy for reliability assessment. A two-stage conceptual framework is defined, where adaptiveness is included to uncover residual faults earlier, while various sampling-based techniques are proposed to improve the efficiency (in terms of variance-test cases tradeoff) by better exploiting the information available to tester. An empirical study is conducted to assess the AST performance and compare the proposed sampling techniques to each other on real programs.

On adaptive sampling-based testing for software reliability assessment / Pietrantuono, Roberto; Russo, Stefano. - (2016), pp. 1-11. (Intervento presentato al convegno IEEE 27th International Symposium on Software Reliability Engineering tenutosi a Ottawa, Ontario, Canada nel 23-27/10/2016) [10.1109/ISSRE.2016.50].

On adaptive sampling-based testing for software reliability assessment

PIETRANTUONO, ROBERTO;RUSSO, STEFANO
2016

Abstract

Assessing reliability of software programs during validation is a challenging task for engineers. The assessment is not only required to be unbiased, but it needs to provide tight variance (hence, tight confidence interval) with as few test cases as possible. Statistical sampling is a theoretically sound approach for reliability testing, but it is often impractical in its current form, because of too many test cases required to achieve desired confidence levels, especially when the software has few residual faults inside. We claim that the potential of statistical sampling methods is largely underestimated. This paper presents an adaptive sampling-based testing (AST) strategy for reliability assessment. A two-stage conceptual framework is defined, where adaptiveness is included to uncover residual faults earlier, while various sampling-based techniques are proposed to improve the efficiency (in terms of variance-test cases tradeoff) by better exploiting the information available to tester. An empirical study is conducted to assess the AST performance and compare the proposed sampling techniques to each other on real programs.
2016
978-1-4673-9001-9
On adaptive sampling-based testing for software reliability assessment / Pietrantuono, Roberto; Russo, Stefano. - (2016), pp. 1-11. (Intervento presentato al convegno IEEE 27th International Symposium on Software Reliability Engineering tenutosi a Ottawa, Ontario, Canada nel 23-27/10/2016) [10.1109/ISSRE.2016.50].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/636129
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 17
  • ???jsp.display-item.citation.isi??? 12
social impact