AQAP-160 vs. CMMI - calidaddelsoftware.com Semana CMMI/03- EADS … · AQAP-160 vs. CMMI Antonio Monzón Systems Integration (IdS) EADS-CASA ... 4.4 Verification process 4.4.2 Verification

1

CASA

02/03/2006Military Transport Aircraft Division Slide 1/35

AQAP-160 vs. CMMI

Antonio MonzónSystems Integration (IdS)

EADS-CASA

CASA


Index

• EADS-CASA Organization Structure

• AQAP-160 Standard

• SQMS: IdS Quality Manual

• CMMI Model

• Process Mapping Example

• CMMI experiences within EADS

2

CASA


IdS Organization

EADS

Airbus

Eurocopter EADS-ST

EADS-AstriumEADS-CASA

MTAD EADS-DE

Engineering Projects

Systems Direction

Avionics Systems Systems Integration (IdS)

SW Department Test Benches Dep.

many others...

SW Engineering & Quality

CASA


AQAP-160 Standard

3

CASA


AQAP-160 ContextAQAP-160 Context

AQAP-160

CASA


AQAP*-160 Content and Model

• AQAP-160 Sources:– ISO/IEC 12207 (80%)

– ISO 9001 (10%)

– Specific Military quality requirements (10%)

• AQAP-160 “add-in”:– AQAP-169 (Meta-

model and tailoring guidelines)

* Allied Quality Assurance Publications (NATO Std)

4

CASA


AQAP-160 Certification

• PECAL/AQAP-160 Certification Authority:– DGAM (Spanish Ministry of Defense)

• PECAL/AQAP-160 Certification Scope:– “Airborne systems embedded SW developed by

Engineering organizations of EADS-CASA”

• PECAL/AQAP-160 Certification Procedure:– Certification kickoff meeting

– Documentation preparation

– Formal Certification Audit (1 day assessment)

– Non-conformities and Improvements proposed

– Corrective Actions to correct non-conformities

– Final Certification resolution

CASA


AQAP-160 StructureChapter 3 Primary life cycle processes requirements

3.1 Supply process

3.2 Acquisition process

3.3 Development process

3.4 Production and Deployment process

3.5 Operation process

3.6 Maintenance process

Chapter 4 Supporting life cycle processes requirements

4.1 Documentation process

4.2 Configuration management process

4.3 Quality assurance process

4.4 Verification process

4.4.2 Verification

4.5 Validation process

4.6 Joint review process

4.7 Audit process

4.8 Problem resolution process

4.9 Management process

4.10 Infrastructure process

4.11 Training process

4.12 Measurement Process

Chapter 5 Tailoring process requirements5.1 Tailoring process

Chapter 6 NATO-specific requirements6.1 Assistance for Government Quality Assurance

6.2 Software quality management system (quality system)

6.3 Products presented to the QAR

6.4 Notification to the QAR

6.5 Availability of information to the QAR

5

CASA


SQMS: IdS Quality Manual

CASA


SQMS

• SQMS = SW Quality Management System

• Definition:– Process framework describing EADS-CASA activities

related to airborne software

• Objectives:– Systematically establish the SW related activities and their

relationships with other Organization processes

– Simplify the required AQAP-160 certification process

– Ease the continuous process improvement

• Operation:– Each time a new project starts, the SQMS is tailored to it

and the adaptation is documented in a SW Quality Plan

6

CASA


SQMS Meta-Model

• SQMS fits perfectly AQAP-160 (as it was conceived as a mirror of this last one)

CASA


SQMS Structure

7

CASA


SQMS Philosophy

• The Quality System describes the set of processes involved in the production of SW (the organization Lifecycle) in abstract terms

• Each process represents a part of the work and it can be decomposed in sub-processes or in activities, performed by abstract roles

• All the projects developed by the organization must be compliant with the Quality System

• Project responsible creates a formal document (SW Quality Plan) where the generic processes contained in the Manual are instantiated and the roles are assigned to concrete persons

• The SQP is a formal statement of what is going to be done and who is responsible for it

CASA


CMMI Model

8

CASA


CMMI Meta-Model - Staged

Common

CASA


CMMI Meta-Model - Continuous

Common

9

CASA


CMMI Process Areas

PP Project Planning REQM Requirements Management MA Measurement and

Analysis

PMC Project Monitoring and Control PPQA Process and Product

Quality Assurance

SAM Supplier Agreement Management CM Configuration

Management

OPF Organizational Process Focus IPM Integrated Project

Management RD Requirements Development DAR Decision Analysis and

Resolution

OPD Organizational Process Definition RSKM Risk Management TS Technical Solution OEI

Organizational Environment for Integration

OT Organizational Training IT Integrated Teaming PI Product Integration

ISM Integrated Supplier Management VER Verification

VAL Validation

4 - Quantitatively

ManagedOPP Organizational Process

Performance QPM Quantitative Project Management

5 - Optimizing OID Organizational Innovation and Deployment CAR Causal Analysis and

Resolution

Engineering Support

2 - Managed

3 - Defined

Process Management Project Management

CASA


Process Management Project Management Engineering Support

4 - Quantitatively Managed

5 - Optimizing

2 - Managed

3 - Defined

Process Mapping to CMMI PA’s

PP

PMC

SAM

REQM

RD

TS

PI

VER

VAL

IPM

RSKM

IT

ISM

OPF

OPD

OT

OPP QPM

CAR

DAR

OEI

MA

PPQA

CM

OID

Project MgmtProcess

ImprovementProcess

CM Process

Validation Process

Measure. Process

QA Process

Verification Process

DevelpomentProcess

10

CASA


SQMS vs CMMI - Continuous

CASA


Process MappingExample

11

CASA


Improvement Process

Last but not least!

CASA


Objectives & Means

• The Improvement Process is used to evaluate the results of the processes that compose the SW Quality System.

• The evaluation uses two types of information:– Feedback from real projects where processes are being

used.

– Technology evolution in methods and tools that impact the processes defined.

• The feedback is provided by:– Measurement results

– Process and Product Audits

– Conclusion Reports from finished Projects

– Suggestion from Team Members

12

CASA


Process Decomposition

Improvementsgathering

Improvementsimplementation

CASA


1. Technology Update

13

CASA


Technology Update• Inputs

– External information sources (RTG14!!!, Internet, Congresses, Magazines, Books, etc.)

• Outputs– Infrastructure/Resources Report

– Subcontractors Profile Report

– Technology Strategy Report

– Tools and COTS Evaluation Reports

• Activities– Analyze Technology Trends

– Perform Evaluations Analysis

– Prepare Technology Strategy Report

– Update Infrastructure Plan

CASA


2. Development Feedback

14

CASA


Development Feedback

• Inputs– Conclusions Report

Report

– Developers Suggestions

– Process Metrics Report

– Product Audit Report

– Product Metrics Report

• Outputs– Improvement Proposals

List

– Process Improvement Plan

• Activities– Analyze Lessons Learned

– Analyze Developer Proposals

– Analyze Audit Reports

– Analyze Metrics Reports

– Prepare List of Proposed Changes

– Decide Changes to be Implemented

– Prepare Plan for Processes Update

CASA


3. Process Update

15

CASA


Process Update

• Inputs– Process Improvement Plan

• Outputs– Updated SQMS Manual (formal normative document)

• Activities– Nominate Process Reviewer(s)

– Modify Processes Description

– Perform Process Review

– Analyze Comments

– Decide on Applicability to Projects

– Publish New QA Manual Release

CASA


Mapping to CMMI

16

CASA


Process Improvement in CMMI

CASA


Practices to Activities MappingProcess Area Specific Goal Specific Practice SQMS Activity

Establish Organizational Process Needs

Analyze Technology Trends Analyze Lessons LearnedAnalyze Developer ProposalsPerform Evaluations AnalysisAnalyze Audit ReportsAnalyze Metrics Reports

Appraise the Organization's Processes Nominate Process Reviewer(s)Perform Process Review

Identify the Organization's Process Improvements Prepare List of Proposed Changes

Establish Process Action PlansPrepare Technology Strategy ReportUpdate Infrastructure Plan Prepare Plan for Processes Update

Implement Process Action Plans Decide Changes to be ImplementedModify Processes Description

Deploy Organizational Process AssetsIncorporate Process Experiences into the Org Process Assets

Decide Changes to be ImplementedModify Processes Description

Collect and Analyze Improvement Proposals

Analyze Technology Trends Analyze Lessons LearnedAnalyze Developer ProposalsPerform Evaluations AnalysisAnalyze Audit ReportsAnalyze Metrics Reports

Identify and Analyze Innovations Prepare List of Proposed Changes

Create Plans for Pilot Improvements Update Infrastructure Plan Prepare Plan for Processes Update

Pilot Improvements

Select Improvements for Deployment Decide Changes to be ImplementedModify Processes Description

Plan the DeploymentManage the DeploymentMeasure Improvement Effects

Organizational Process Focus

(Level 3)

Determine Process Improvement Opportunities

Plan and Implement Process Improvement

Activities

Organizational Innovation and

Deployment(Level 5)

Select Improvements

Deploy Improvements

17

CASA


CMMI in EADS

CASA


CMMI Experience in EADS• Airbus (France)

– EYTMD Data Processing: CMMI-SW L2 (2004)

– Corporative IT: CMMI-SW L3 (in process)

• EADS-DCS/SDC (France)– CMMI-SE/SW L2 (certification objective for end of 2007)

– CMMI-SE/SW L3 (certification objective for mid 2009)

• EADS-ST (France)– No plans for short term certification, but interested in CMMI

• MBDA (France)– No plans for short term certification, but interested in CMMI

• EADS-CASA (Spain)– No plans for short term certification, but interested in CMMI

– Future objective: CMMI-SE/SW – Continuous L3 (no further level)

18

CASA


Questions?

Documents

AQAP-160 vs. CMMI - calidaddelsoftware.com Semana CMMI/03- EADS … · AQAP-160 vs. CMMI Antonio Monzón Systems Integration (IdS) EADS-CASA ... 4.4 Verification process 4.4.2 Verification