AuthorsT. Yue, S. Ali and M. Zhang
TitleApplying A Restricted Natural Language Based Test Case Generation Approach in An Industrial Context
AfilliationSoftware Engineering
Project(s)The Certus Centre (SFI), MBT4CPS: Model-Based Testing For Cyber-Physical Systems
Publication TypeProceedings, refereed
Year of Publication2015
Conference NameInternational Symposium on Software Testing and Analysis (ISSTA), Maryland, USA, July 14-17

Based on our experience of collaborating with industry, we observed that test case generation usually relies on test case specifications (TCSs), commonly written in natural language (NL), specifying test cases of a System Under Test at a high level of abstraction. In practice, TCSs are commonly used by test engineers as reference documents to perform any of the following activities: 1) Manually executing test cases documented as TCSs; 2) Manually coding test cases in a test scripting language for automated test case execution. In the latter case, the gap between TCSs and executable test cases has to be filled by test engineers, requiring a significant amount of coding effort and domain knowledge. In addition, both cases prefer an easy-to-apply and a NL based TCS language.

Motivated by the above observations from the industry, we first propose, in this paper, a TCS language, named as Restricted Test Case Modeling (RTCM), which is based on NL and composed of an easy-to-use template, a set of carefully selected restriction rules and keywords. Second, we propose a test case generation tool (aToucan4Test), which takes TCSs in RTCM as input and generates either manual test cases or automatically executable test cases, based on various coverage criteria defined on RTCM. To assess the applicability of RTCM, we manually modeled two industrial case studies and examined 30 automatically generated TCSs. To evaluate aToucan4Test, we modeled three subsystems of a Video Conferencing System developed by Cisco Systems, Norway (our industrial partner) and automatically generated executable test cases. These test cases were successfully executed on two commercial software versions. In the paper, we also discuss our experience of applying RTCM and aToucan4Test in an industrial context and compare our proposed approach with other model-based testing methodologies.

Citation Key23472