testing standards and processes - Team Ztheteamzuniga.org/.../2016/...to-Testing-Standards-and-Processes_f.pdf · testing standards and processes © Nokia Solutions and Networks 2014

© Nokia Solutions and Networks 2014

<Change information classification in footer>

testing standards and processes



Agenda

• Purpose of Standards

• Motivation behind standard creation

• The Development of standards

• ISO/IEC/IEEE 29119



Pictures from: http://www.obsessionistas.co.uk/collections/2012/8/6/plugs-and-sockets-0116.html

http://www.obsessionistas.co.uk/collections/2012/8/6/plugs-and-sockets-0116.html



What is a Standard?

• “Guideline documentation that reflects agreements on

products, practices, or operations by nationally or

internationally recognised industrial, professional, trade

associations or governmental bodies”

• -ISO

• Guidelines documents because they are not compulsory

unless mandated by an individual or an organization

• Agreements because commonly they reflect consensus on

the part of a group



Standards

• Standards provide a “body of knowledge” that includes the basis for a professional discipline

• Standards are basis for:- Communication - common terms are used

- Professional qualifications

- Certification/compliance schemes

- Benchmark of “good industry practice”

- Contracts

- Interoperability and consistency



Quality

Current

Practice

Best

Practice

Good

Practice



Professional

Standards

National

Standards

Market

StandardsOrganizational

Standards

Industry

Standards



ISO/IEC/IEEE 29119

• ISO/IEC/IEEE 29119 Software Testing is an internationally agreed set of standards for software testing that can be used within any software development life cycle or organization.

• By implementing these standards, organizations will be adopting the only internationally-recognised and agreed standards for software testing, which will provide organizations with a high-quality approach to testing that can be communicated throughout the world. There are currently five standards.



The 5 Standards

• ISO/IEC 29119-1: Concepts & Definitions (published September 2013)

• ISO/IEC 29119-2: Test Processes (published September 2013)

• ISO/IEC 29119-3: Test Documentation (published September 2013)

• ISO/IEC 29119-4: Test Techniques (at DIS stage, anticipating publication in late 2014)

• ISO/IEC 29119-5: Keyword Driven Testing (at CD stage, anticipating publication in 2015)



• The ISO/IEC/IEEE 29119 standards replace a

number of existing software testing standards:

• IEEE 829 Test Documentation

• IEEE 1008 Unit Testing

• BS 7925-1 Vocabulary of Terms in Software

Testing

• BS 7925-2 Software Component Testing Standard



ISO/IEC/IEEE 29119-1 (Part 1)

• The aim of ISO/IEC/IEEE 29119-1 is to facilitate understanding and use of all other standars in the 29119 series. ISO/IEC/IEEE 29119-1 introduces the vocabulary on which all standards in the 29119 series are built and provides examples of the application of each concept in practice. Part 1 is informative and provides definitions, a description of the concepts of software testing and ways to apply the processes, documents and techniques defined in the 29119 series.



Part 1: Concepts and Vocabulary

• Software Testing Concepts

• Introduction to software testing

• Relationship between testing, development and maintenance

• Implication of lifecycle models

• Approaches to testing

• Testing vocabulary






• The aim of ISO/IEC/IEEE 29119-2 is to define a generic process model for software testing that can be used within any software development life cycle. The model specifies test processes that can be used to govern, manage and implement software testing in any organisation, project or testing activity. The testing process is based on a three-layer process model that covers:- Organizational Test Specifications (e.g. Organizational Test Policy,

Organizational Test Strategy)

- Test Management

- Dynamic Testing





Detailed View



Test Management Process



Test Planning Process



Test Monitoring and Control Process



Dynamic Test Process




• The aim of ISO/IEC/IEEE 29119-3 is to define templates

for test documentation that cover the entire software

testing life cycle. Each template can be tailored to suit the

unique needs of each organization implementing the

standard, to support the standard's implementation within

any software development life cycle model. All templates

align with the test process defined in ISO/IEC/IEEE 29119-

2 and can be produced by applying the processes that are

defined in that standard.




• The aim of ISO/IEC/IEEE 29119-4 Test Techniques is to define one international standard covering software test design techniques (also known as test case design techniques or test methods) that can be used during the test design and implementation process within any organisation or software development life cycle model. The test design techniques that are presented in this standard can be used to derive test cases that can be used to collect evidence that the requirements of each system under test have been met and/or that detects are present.




• The aim of ISO/IEC/IEEE 29119-5 is to define an international standard for supporting Keyword-Driven Testing. Keyword-Driven Testing is a way of describing test cases by using a predefined set of Keywords. These Keywords are names which are associated with a set of actions that are required to perform a specific step in a test case. By using keywords to describe test steps instead of natural language, test cases can be easier to understand, to maintain and to automate.

Documents

testing standards and processes - Team Ztheteamzuniga.org/.../2016/...to-Testing-Standards-and-Processes_f.pdf · testing standards and processes © Nokia Solutions and Networks 2014