Proceedings of ISP RAS


Method of Symbolic Test Scenarios Automated Concretization

N.V. Voinov (SPbPU, Saint-Petersburg), P.D. Drobintsev (SPbPU, Saint-Petersburg), I.V. Nikiforov (SPbPU, Saint-Petersburg), V.P. Kotlyarov (SPbPU, Saint-Petersburg), A.V. Kolchin (Glushkov Institute of Cybernetics NAS, Ukraine)

Abstract

When providing correctness checking for the models of software systems which include data types with wide range of values, a single symbolic behavioral scenario may cover a set of equivalent scenarios with concrete values. This feature is especially useful for systems with integer data types. However symbolic scenarios cannot be used as executable tests, they shall be concretized prior to execution. On the other hand, modern industrial software projects may contain many thousands of tests with nontrivial dependencies between their parameters. Manual selection and insertion of concrete values is impossible which requires full automation of the process. Besides, the actual experience in modern testing shows that efforts on bugs detection decrease significantly when directed method of selecting values is used instead of random selection of values. Concretization process shall follow a test plan prepared by tester. Such plans shall be flexible and generated based on standard templates or plans modified by user.
Method of symbolic test scenarios automated concretization which resolves mentioned issues is described in the article. It allows to control coverage of boundary test parameters values which increases the quality of developed software.
The developed method was successfully integrated into single complex technology of verification and testing which includes creation of a formal model based on initial requirements, automated symbolic verification, generation and concretization of symbolic behavioral scenarios, generation of test sets based on concretized scenarios and analysis of tests execution verdict. Results of method application within integrated technology are also shown.

Keywords

concretization; symbolic behavior scenario; software testing

Edition

Proceedings of the Institute for System Programming, vol. 27, issue 3, 2015, pp. 115-124

ISSN 2220-6426 (Online), ISSN 2079-8156 (Print).

DOI: 10.15514/ISPRAS-2015-27(3)-8

Full text of the paper in pdf Back to the contents of the volume