Nikita Voinov

Generation of Test Scenarios for Non Deterministic and Concurrent Telecommunication Applications

14.11.2015

14 November 2015

2

Information and Control System Department of ICST

• Software development methods:• Model Driven Development (MDD)• Model Driven Software Development (MDSD)• Model Driven Engineering (MDE)

• Software testing methods:• Model Driven Testing (MDT) • Model Based Testing (MBT)

Introduction

3

Information and Control System Department of ICST

Model Oriented Approach

• Benefits:• Reduction of software development cost via automation• Simplification of test development process• Involving of customer into development process

• Issues:• A shortage of engineers with MDT expertise• Different levels of abstraction• The problem of test suite explosion• Necessity to customize MDT approaches in projects from

different areas of industry

4

Information and Control System Department of ICST

Fragment of Telecom Project in UCM Notation

5

Information and Control System Department of ICST

Fragment of Multi Concurrent Model in UCM Notation

6

Information and Control System Department of ICST

Verification and Testing Within Single Technology

• Test Coverage criteria• Functional coverage• Responsibility coverage• Branches coverage • Paths coverage

• Verification techniques (performed by VRS toolset)• Model checking• Symbolic verification• Searching of equivalence classes

7

Information and Control System Department of ICST

Non Deterministic Behavior: active alternative

Direction of the signals in Req1 and Req2: from test to SUT.Two linear tests shall be used.

8

Information and Control System Department of ICST

Non Deterministic Behavior: passive alternative

Direction of the signals in Req1 and Req2: from SUT to test.Linear tests can not be used, adding of “alt” construction is required.

9

Information and Control System Department of ICST

Concurrent Behavior: linear traces

Correctness of the test strictly depends on the direction of the signals.

10

Information and Control System Department of ICST

Concurrent Behavior: solution

Par construction can be automatically added into particular test based on syntax analysis of high level formal model.

11

Information and Control System Department of ICST

Concurrent Behavior: example

12

Information and Control System Department of ICST

Results

Project BP number Non linear BP,

%

Test scenario number (Linear)

Test scenario number

(Linear + non linear)

Reduce of test suite,

%

SMTP 30 10 10 8 20

CDMA 205 43 1171 615 48

Satellite terminal

191 15 396 291 27

Examples of not huge projects: average reduction of test suite with usage of suggested approach is near 30%

Thank You

14

Information and Control System Department of ICST

Proved Model of System Under Test