Monkey Fuzz Testing (MFT), a form of random testing, continues to gain popularity to test Android apps because of its ease of use. (Untrained) programmers use MFT tools to fully automatically detect certain classes of faults in apps. A challenge for these tools is the lack of a stopping criterion---programmers currently typically stop these tools when they run out of time. In this paper, we use the notion of the Saturation Effect of an MFT tool on an app under test to define a stopping criterion, parameterized by the app's preconditions and the tool's configurations. We have implemented our approach in the AndroidRipper MFT tool. We experimentally report results on 18 real Android app subjects. We show that the saturation effect is able to stop testing when test adequacy has been achieved without wasting test cycles.
Exploiting the Saturation Effect in Automatic Random Testing of Android Applications / Amalfitano, Domenico; Amatucci, Nicola; Fasolino, ANNA RITA; Kowalczyk, Emily; Memon, Atif M.; Tramontana, Porfirio. - (2015), pp. 33-43. (Intervento presentato al convegno 2nd ACM International Conference on Mobile Software Engineering and Systems - MOBILESoft 2015 tenutosi a Florence (Italy) nel May 16-17, 2015) [10.1109/MobileSoft.2015.11].
Exploiting the Saturation Effect in Automatic Random Testing of Android Applications
AMALFITANO, DOMENICO;AMATUCCI, NICOLA;FASOLINO, ANNA RITA;TRAMONTANA, PORFIRIO
2015
Abstract
Monkey Fuzz Testing (MFT), a form of random testing, continues to gain popularity to test Android apps because of its ease of use. (Untrained) programmers use MFT tools to fully automatically detect certain classes of faults in apps. A challenge for these tools is the lack of a stopping criterion---programmers currently typically stop these tools when they run out of time. In this paper, we use the notion of the Saturation Effect of an MFT tool on an app under test to define a stopping criterion, parameterized by the app's preconditions and the tool's configurations. We have implemented our approach in the AndroidRipper MFT tool. We experimentally report results on 18 real Android app subjects. We show that the saturation effect is able to stop testing when test adequacy has been achieved without wasting test cycles.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.