Institute for Telematics University of Lübeck, Germany M. Ebner, M. Schmitt, J. Grabowski Test...

Preview:

Citation preview

Institute for TelematicsUniversity of Lübeck, Germany

M. Ebner, M. Schmitt, J. Grabowski

Test Generation

with

Autolink and TestComposer

2 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Motivation

• Systematic testing of complex systems

• Test specification and description

• Formal Specification of the System under Test (SUT)

• Automatic test generation

Autolink and TestComposer

3 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

4 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

5 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Distributed Test Architecture

6 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test Purpose Computation

• Coverage– large structural coverage– coverage unit and observation step

• Search strategy– breadth first– depth first, iterative depth first– repetitive local exploration

• Automatic computation of postambles

7 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

8 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test Purpose Specification

• Manual specification– Interactive Simulation– Observer Processes

• Abstract test purposes

• MSC test purpose structuring– Preamble, Test body, Postamble– HMSC and MSC expressions

9 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

10 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test Case Generation

• State Space Exploration– find paths corresponding to test purpose

– postamble computation for alternative paths

– “On the fly” generation

• Direct translation of MSCs to TTCN– Problem: SDL model may be incomplete

– consistency checks with regard to interface

11 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

12 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Test suite production

• Generate TTCN test suite parts

• Provide suite customisation

• Enhance readability • Reduce manual

post-processing

• Test grouping• Test step format• Test purpose

comments• SDL signal mapping

on ASPs or PDUs• Timer

13 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

14 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Summary I

• TestComposer– Flexible in test purpose description – Postamble computation– Support of timers– API for test suite access

• Autolink– Supports MSC’96– Direct translation from MSC to TTCN– Test suites for distributed test architectures

15 Test Generation with Autolink and TestComposer

Institute for TelematicsUniversity of Lübeck, Germany

Summary II

• Same principles but different kinds of test generation solutions

Tools complement each other combination of the best features would

enhance practical usability

Recommended