Proceedings of ISP RAS


Applying iterative dynamic analysis to programs with graphical user interface

M.K. Ermakov (ISP RAS, Moscow, Russia)
A.Y. Gerasimov (ISP RAS, Moscow, Russia)
D.O. Kutz (ISP RAS, Moscow, Russia)
A.A. Novikov (ISP RAS, Moscow, Russia)

Abstract

This paper is dedicated to practical research in the field of automated testing and analysis of software that features a graphical user interface. Current tendencies in user interface development favour semi-automatic approaches that employ human experts to create and prepare test suites. The ever-increasing complexity of software leads to decreased effectiveness of these approaches, especially when one considers large amounts of computational resources available during development. We present a fully automatic approach to dynamic analysis of program graphical interfaces. Our approach is based on the open-source GUITAR tool, which we have identified among other industrial and academic tools as the one closest to full automation. While highly efficient, GUITAR nevertheless has certain drawbacks and limitations which might cause insufficient accuracy in modelling the graphical interface structure and its individual elements. In turn, these limitations lead to fragments of graphical interface not getting processed during analysis or cause incorrect (i.e. not reproducible in practice) test cases to be generated. Our contributions include a set of modifications: incremental graphical interface model generation, improved identification of graphical interface element attributes and side effects, and finally a test case generation algorithm that focuses on reaching unprocessed graphical interface elements to check their functionality and improve the model. We have tested our modifications on a set of open source projects originally checked by GUITAR developers and achieved positive results: increased precision of GUI structure model and theoretically can decrease number of inapplicable test cases. Finally, we discuss several potential improvements for future work, including, in particular, the use of dynamic symbolic execution methods.

Keywords

dynamic analysis; program analysis; GUI testing; test coverage

Edition

Proceedings of the Institute for System Programming, vol. 29, issue 1, 2017, pp. 119-134.

ISSN 2220-6426 (Online), ISSN 2079-8156 (Print).

DOI: 10.15514/ISPRAS-2017-29(1)-8

Full text of the paper in pdf (in Russian) Back to the contents of the volume