Proceedings of ISP RAS


Dynamic analysis of programs with graphical user interface based on symbolic execution

S.P. Vartanov (ISP RAS, Moscow, Russia)
A.Y. Gerasimov (ISP RAS, Moscow, Russia)
M.K. Ermakov (ISP RAS, Moscow, Russia)
D.O. Kutz (ISP RAS, Moscow, Russia)
A.A. Novikov (ISP RAS, Moscow, Russia)

Abstract

In this paper, we explore the possibilities of applying dynamic symbolic execution (or concolic testing) methods to applications with graphical user interfaces. Such applications inherently feature interactive user input processing and multithreaded execution. These features typically decrease the effectiveness of dynamic symbolic execution by increasing the volume of processed code not related to actual application functionality. We present a hybrid approach that combines commonly used GUI test automation methods based on GUI model excavation with dynamic symbolic execution methods to construct test cases for checking internal application logic. We have implemented this approach using two open-source tools – test automation framework GUITAR and Java byte-code static instrumentation framework Coffee Machine. GUI model extracted automatically by GUITAR tool is extended with symbolic traces relevant to application GUI event handlers. Our test generation module for GUITAR combines these symbolic traces into complex queries to be processed by SMT solver. The resulting test cases are valid within automatically extracted GUI structure model and allow to check different execution paths in GUI event handler code. We have checked our hybrid approach on a set of small open-source applications and identified several bugs caused by uncaught exceptions. The paper is concluded with an overview of current limitations and possible improvements of the hybrid approach.

Keywords

dynamic analysis; program analysis; GUI testing; test coverage

Edition

Proceedings of the Institute for System Programming, vol. 29, issue 1, 2017, pp. 149-166.

ISSN 2220-6426 (Online), ISSN 2079-8156 (Print).

DOI: 10.15514/ISPRAS-2017-29(1)-10

Full text of the paper in pdf (in Russian) Back to the contents of the volume