Improving Mobile Application GUI Testability with Deep Learning-based Test Case Generation

Putu Krisna Andyartha, Bella Dwi Mardiana, Umar Hasan, Nazhifah Elqolby, Daniel Siahaan*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The proliferation of mobile applications created the need to automate graphical user interface (GUI) testing, and one notable practice is deep learning-based test case generation. However, the testability impact of this practice has yet to be explored. Testability and automation are strongly correlated, where low testability reduces the benefits of automation, while ineffective automation will negatively affect testability. This work aimed to explore the effect of deep learning-based GUI test generation on the testability of mobile applications. First, we compared four deep learning algorithms to classify mobile GUI elements (Detectron2, EfficientDet, YOLOv5, and YOLOv8). Comparison results showed that YOLOv8 outperformed the other models in precision, recall, and AP50 scores. Afterward, we applied test case generation on two Android applications where metrics defined by ISO/IEC 25023:2016 provide standards to measure testability. Evaluation results showed improvements in both applications' testability, where the generated test cases increased the conformance of the required test coverage. We noted at least six times improvement in testability. This work concluded that deep learning-based GUI test case generation could improve the testability of mobile applications by creating dozens of applicable test cases.

Original languageEnglish
Title of host publicationIWAIIP 2023 - Conference Proceeding
Subtitle of host publicationInternational Workshop on Artificial Intelligence and Image Processing
EditorsYessi Jusman
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages28-33
Number of pages6
ISBN (Electronic)9798350382914
DOIs
Publication statusPublished - 2023
Event2023 International Workshop on Artificial Intelligence and Image Processing, IWAIIP 2023 - Hybrid, Yogyakarta, Indonesia
Duration: 1 Dec 20232 Dec 2023

Publication series

NameIWAIIP 2023 - Conference Proceeding: International Workshop on Artificial Intelligence and Image Processing

Conference

Conference2023 International Workshop on Artificial Intelligence and Image Processing, IWAIIP 2023
Country/TerritoryIndonesia
CityHybrid, Yogyakarta
Period1/12/232/12/23

Keywords

  • deep learning
  • graphical user interface
  • mobile applications
  • test case generation
  • testability

Fingerprint

Dive into the research topics of 'Improving Mobile Application GUI Testability with Deep Learning-based Test Case Generation'. Together they form a unique fingerprint.

Cite this