124
Computer System Validation LifeCycle Planning Presented by Sharon Strause, Senior Consultant QACV Consulting, LLC Computer and Software Validation Hilton Philadelphia at Penn’s Landing Philadelphia, PA April 27 – 29, 2015

Computer System Validation LifeCycle Planning - CBI A_pres(3).pdf · Guide To Inspections of Computerized System In The Food Processing ... Electronic Data Archiving, ... GAMP® Good

Embed Size (px)

Citation preview

Computer System ValidationLifeCycle Planning

Presented by

Sharon Strause, Senior Consultant

QACV Consulting, LLC

Computer and Software Validation

Hilton Philadelphia at Penn’s Landing

Philadelphia, PA

April 27 – 29, 2015

Sharon Strause

15 years with the

Pharmaceutical industry

Documentation

Computer System Validation

Quality Assurance in

information management.

11 years consulting

LifeScience Industries

Consumer Product Industries

Software Development Companies

Copyright QACV Consulting, LLC_2015

Where are you from?

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Confidence building activity

Discover errors and ‘bugs’

Business benefit

Efficiency gains in current processes

New business process opportunities

DIRTFT (“Do It Right The First Time”)

Regulatory compliance

Why Validate

Copyright QACV Consulting, LLC_2015

Pharmaceutical and Device Regulations US, Japan, EU, etc.

HIPAA

OSHA

EPA

DEA

DOD

Sarbanes-Oxley

ISO

Regulatory Compliance

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

What to specifically validate Dictated by the predicate rules

FDA has also indicated other business critical processes Not called out in the predicate rules Should be evaluated to determine the need for

validation

Validation and the FDA

Copyright QACV Consulting, LLC_2015

Hardware is considered to be equipment within the meaning of the CGMP regulations.

Software is regarded as records or standard operating procedures (instructions) within the meaning of the CGMP regulations.

Software maintenance is considered revision or change control.

FDA and CGxPs - Interpretation

(CPG 7132a.11)

Copyright QACV Consulting, LLC_2015

FDA and CGxPs

Record controls require programs to ensure accuracy and security of computer inputs, outputs, and data.

Record access requirements - available for inspection and subject to reproduction.

Copyright QACV Consulting, LLC_2015

The following slides are from two FDA presentations

“Current Status And Future Directions Of Part 11”,

September 21, 2004, Joseph C. Famulare, Director

“Update on Part 11 Regulation and Guidance”,

September 12, 2006, George R Smith Jr.,

Consumer Safety Officer

They show the significance of FDA interpretation

against the predicate rules.

Copyright QACV Consulting, LLC_2015

211.68 – validation requirements of automated equipment

211.100 (a) - written procedures for production and process control

211.22 (a) – Quality control unit has the authority to approve and reject

211.67 ( c) – Records shall be kept of maintenance, cleaning, sanitizing, and inspection

GMP

Copyright QACV Consulting, LLC_2015

211.103 - calculations of yield shall be performed by one person and independently verified by a second person

211.180 (a), (b), and ( c) – retention period for records

211.180 (d) – records retained can be original or true copies

211.194 (a) - Laboratory records shall include complete data derived from all tests necessary to assure compliance with established specifications and standards

GMP

Copyright QACV Consulting, LLC_2015

50.20 – human cannot be involved in research without having a legally effective informed consent

56.108 (a) – IRBs must follow written procedures 56.115 (a) (5) – documentation of IRB activities 312.56 ( c) – sponsors shall review and evaluate

evidence related to safety and effectiveness 312.57 (a) – Records must be Accurate & Complete 11.10 (e) – Changes to e-recs must not obscure

previously recorded information

GCP

Copyright QACV Consulting, LLC_2015

58.29 (b) – must maintain current summary of training for those engaged, or supervising the conduct of a non-clinical study

58.33 (b) – all experimental data… must be accurately recorded

58.35 (b) (4) – periodically submit a written status report noting problems and corrections

GLP

Copyright QACV Consulting, LLC_2015

58.63 ( c) – records maintained of all inspections, maintenance records, testing, calibration and/or standardizing operations

58.107 (d) – receipt and distribution of each batch is documented

58.185 (b) – final report shall be signed and dated by the study director

GLP

Copyright QACV Consulting, LLC_2015

21 CFR 812.145 (a) & (b) - Records must be Accurate & Complete

21 CFR 812.140 – must retain records required by 812

21 CFR 11.10 (e) – Changes to e-recs must not obscure previously recorded information

Devices

Copyright QACV Consulting, LLC_2015

Validation Example – GMPs Key Words: ‘perform a function

satisfactorily…according to a written program’ 21 CFR 211.68 (a)

Validation Example – Medical Devices Key Words (not limited to): shall be validated, perform a

function satisfactorily 21 CFR 820.70(i)

Record Keeping Examples Key Words (not limited to): ‘must maintain’, ‘records

shall be kept’, ‘records shall include’ 21 CFR 58.29 (b), 21 CFR 211.67 (c)

FDA - Key Words

Copyright QACV Consulting, LLC_2015

Audit Trail Examples Key Words (not limited to): ‘shall include complete…’,

‘must be complete’ 21 CFR 211-194 (a), 21 CFR 812.145 (a) & (b)

Retention Period Examples Key Words (not limited to): ‘retention period’

21 CFR 211.180 (b) & (c)

Electronic Signatures Key Words (not limited to): ‘shall be verified’, ‘shall

approve or reject’, ‘…shall be signed and dated’ 21 CFR 211.103, 21 CFR 211.22 (a), 21 CFR 312.56 (c), 21 CFR

58.185 (b)

FDA- Key Words

Copyright QACV Consulting, LLC_2015

SOP Examples

Key Words (not limited to): ‘must follow written procedures’ 21 CFR 56.108 (a), 21 CFR 211.100 (a)

FDA – Key Words

End of FDA presentation slides

Copyright QACV Consulting, LLC_2015

Sec. 820.198 (a) Complaint files. Each manufacturer shall maintain complaint files. Each manufacturer shall establish and maintain procedures for receiving, reviewing, and evaluating complaints by a formally designated unit. Such procedures shall ensure that: 1) All complaints are processed in a uniform and timely

manner; 2) Oral complaints are documented upon receipt; and 3) Complaints are evaluated to determine whether the

complaint represents an event which is required to be reported to FDA under part 803 or 804 of this chapter, Medical Device Reporting.

Automated Complaint Handling System -Example

Copyright QACV Consulting, LLC_2015

Automated Complaint Handling System -Example

Sec. 820.198 (a) Complaint files. Each manufacturer shall maintain complaint files. Each manufacturer shall establish and maintain procedures for receiving, reviewing, and evaluatingcomplaints by a formally designated unit. Such procedures shall ensure that: 1) All complaints are processed in a uniform and timely

manner; 2) Oral complaints are documented upon receipt; and 3) Complaints are evaluated to determine whether the

complaint represents an event which is required to be reported to FDA under part 803 or 804 of this chapter, Medical Device Reporting.

Data Entry Queries

Time

stamps

Review

indicators,

Signatures

Std. Forms

Status indicators

and trackingCopyright QACV Consulting, LLC_2015

Use the regulations to get direction on what to validate

Use guidance documents and industry standards/practices to get direction on how to validate

Validation

Copyright QACV Consulting, LLC_2015

General Principles of Software Validation; Final Guidance for Industry and FDA Staff: Jan 2002

Guide to Inspection of Computerized Systems in Drug Processing: Blue Book 1983

Guidance for Industry Computerized Systems Used in Clinical Investigations: May 2007

Guide To Inspections of Computerized System In The Food Processing Industry

Guidance for Industry Part 11, Electronic Records; Electronic Signatures —Scope and Application: Feb 2003

Pharmaceutical Inspection Convention (PIC) GMP Guideline PI 011-3 Good Practices for Computerized Systems in Regulated “GXP” Environments, Sep 2007.

GAMP5 A Risk-Based Approach to Compliant GxP Computerized Systems: Feb 2008

Guidance Documents(Partial List)

Copyright QACV Consulting, LLC_2015

A Risk-Based Approach to Electronic Records and Signatures, Feb 2005

A Risk-Based Approach to GxP Compliant Laboratory Computerized Systems (Second Edition) Oct 2012

A Risk-Based Approach to GxP Process Control Systems (Second Edition) Feb 2011

A Risk-Based Approach to Operation of GxP Computerized Systems - A Companion Volume to GAMP 5, Jan 2010

GAMP® Good Practice Guides

Copyright QACV Consulting, LLC_2015

A Risk-Based Approach to Regulated Mobile Applications, Oct 2014

A Risk-Based Approach to Testing of GxP Systems (Second Edition), Dec 2012

Electronic Data Archiving, Jul 2007

Global Information Systems Control and Compliance, Nov 2005

IT Infrastructure Control and Compliance, Sep 2005

Manufacturing Execution Systems – A Strategic and Program Management Approach, Feb 2010

GAMP® Good Practice Guides (Cont’d)

Copyright QACV Consulting, LLC_2015

Overall validation model

Established procedures

Templates for key deliverables

Well defined maintenance phase

A Good Validation Program

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Continues to see significant problems with data

integrity (including outright fraud)

Does not trust what it’s seeing and what the

pharmaceutical industry is saying about its impact

Wants to return back to the original intent and

objectives

Why is Part 11 Back in the News?

FDA:

Copyright QACV Consulting, LLC_2015

CDER announced this initiative in May 2010

To “evaluate the current pharmaceutical industry

understanding of, and compliance with, 21 CFR Part

11” and “where industry may not be complying

with, or understand, the enforcement approach as

stated in the guidance”

Part 11 “Tag-Along” Inspections

Copyright QACV Consulting, LLC_2015

Some of the possible outcomes include –

Maintaining the “status quo, plus publishing

additional guidance”

“Amending the existing Part 11 regulation

and/or preamble”

CDER’s Public Statements

Copyright QACV Consulting, LLC_2015

Some of the possible outcomes include –

“Proposing new wording / language to existing

CPGs and CPMGs that contain outdated

interpretations of Part 11 requirements”

“Revoking” or “amending” the current Scope and

Application guidance

CDER’s Public Statements

Copyright QACV Consulting, LLC_2015

Applies to files/records required by predicate rule.

Applies to all GxP records saved on electronic media.

Applies to application software/associated documentation

Scope of Rule

Copyright QACV Consulting, LLC_2015

Predicate Rules

GxP Regulations Good Laboratory

Practices (GLP)

Good Clinical Practices (GCP)

Good Manufacturing Practices (GMP)

Utilize to determine and apply the appropriate sections of any GxP regulation to computerized systems. Hardware = Equipment

Software = Records

Maintenance = Revision or Change Control GxMP Applicability to Hardware

and Software (CPG 7132a.11).

Copyright QACV Consulting, LLC_2015

Part 11 requires the retention of electronic records in electronic form.

The predicate rule establishes the length of time that a record must be maintained.

Linkage between Part 11 & the Predicate Rules

Copyright QACV Consulting, LLC_2015

Part 11 - Where does it apply?

Clinical

TrialsRegistration

Manufac-

turingDistribution

Research &

Development

Quality

Assurance

Electronic

Notebooks,

Reports,

Databases

Automated

Data

Collection

and

Reporting

CANDA’s

Updates,

Reviews

Electronic

Batch

Records,

Document

Management

Electronic

Notebooks,

Auditing,

Validation

Shipping

Documentation,

C’s of A

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV Planning

Project Methodology

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

“If you don’t know where you are going, you are likely to end up someplace else!”

Lewis Carroll

Planning

Copyright QACV Consulting, LLC_2015

People vs. Technology

Project management is a job that deals mostly with people.

Technology is secondary.

James Lewis

Planning – Basic Elements

Copyright QACV Consulting, LLC_2015

Problem Definition - Quote:

80% of projects that fail do so at the outset because they have not been defined properly……James Lewis

Helps define your solution/option suite

Assists project team with scope control.

Planning – Basic Elements

Copyright QACV Consulting, LLC_2015

Quote:

Those who fail to plan, plan to fail….FDA

Common Characteristic of unsuccessful projects

Conducted in secret

Project plans

Planned by the people who will use them to complete the project

Planning – Basic Elements

Copyright QACV Consulting, LLC_2015

In the beginning focus on what you need in the end…why are we implementing and

validating this system?

Define early what to validate and a risk based approach to how and why.

Planning

Copyright QACV Consulting, LLC_2015

Project Methodology

Copyright QACV Consulting, LLC_2015

Project management Key to SDLC

Stage Gates Concept

Early Planning – Project Initiation

Definition Requirements

Solution Analysis

Quality Review

Don’t Plan to Fail (1)

Copyright QACV Consulting, LLC_2015

Stage Gates (Continued) Construction

Detailed Design Assemble/Test Quality Review

Implementation Preparation Warranty Quality Review

Benefit Quality Review

Sustain the Pipeline Quality Review

Don’t Plan to Fail (2)

Copyright QACV Consulting, LLC_2015

A person or organization (e.g. customer, sponsor, performing organization, or the public) that is actively involved in the project, or whose interest may be positively or negatively affected by the execution or completion of the project. A stakeholder may also exert influence over the project and its deliverables.

Identifying Stakeholders

Copyright QACV Consulting, LLC_2015

Management

User Community

Project Team

Technical Team

Power Users

Support Team

Key Stakeholders

Copyright QACV Consulting, LLC_2015

Total Computerized System

Controlling Computer System

Software

Hardware

Controlled Process

Equipment

Operating Procedures and Documentation

PeopleCopyright QACV Consulting, LLC_2015

Total System(Computerized System)

7

Controlling System(Computer System)

3

Controlled Process

6

Hardware

2

Software

1

Equipment

4

Operating

Procedures and

Documentation

5

Operational Environment8

... and

all the links

between the boxes

What needs to be validated?

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV Quality Process

SDLC

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Quality Process in place includes….

SDLC Methodology

Project Planning

Vendor Management

Personnel Qualifications

Documentation Standards & Procedures

Methods for review & approval

Design Standards

Programming Standards

Configuration Management

Testing Standards & Procedures

Separation of Development, Test and Production Environments (if possible)

Copyright QACV Consulting, LLC_2015

Quality Process in place includes….

Move to Production Process

Clearly defined responsibilities

Involvement of:

Customer/User

Quality Assurance professionals

Technology Professionals

Change Management

Training process

Process for continuous evaluation, incident monitoring, error correction

Processes and procedures for physical & logical security of system and data

Copyright QACV Consulting, LLC_2015

Example - System Development Life Cycle

Copyright QACV Consulting, LLC_2015

Example - System Development Life Cycle

Concept

Phase

Require-

ments

Phase

Design

Phase

Implemen-

tation

Phase

Integration

Phase

Installation

Phase

Maintenance

Phase

System Development Life Cycle

• Feasibility Study

Report

- Project Scope

- Risk/Safety

Analysis

- Process Desc.

and PIDs

- Technology

Assessment

- Regulatory

Assessment

• Training

Requirements

• Management

Approval

• Appropriation

Approval

• TPM Review

• Detail Project Plan

• Project Plan for

Remaining Phases

• Validation Plan

• Vendor Quality

Management Plan

• Vendor Qualification

Report

• Risk/Safety

Analysis

• Requirements

Specifications

• Functional

Specifications

• Training Plan

• User/Tech/Train

Manuals Plan

• Test Plan

• TPM Review

• Bus Tech Risk ID

• Project Plan

• Approvals NOTE:

- Documentation deliverables may be developed during

one phase of the life cycle and updated in one or more

subsequent phases.

• Risk/Safety

Analysis

• Requirements

Specification

• Functional

Specifications

• System Design

Specifications

• Traceability Matrix

• Test Plan

• Development Test

Plan

• Factory Acceptance

Test (FAT)

• IQ, OQ and PQ

• Training Plan

• User/Tech/Train

Manuals

• Conversion Plan

• TPM Review

• Approvals

• In-Process Audit

Report

• Requirements

Specifications

• Functional

Specifications

• System Design

Specifications

• Traceability Matrix

• Development Test

Plan

• IQ, OQ and PQ

• FAT Plan

• Source Code

• Executable Code

• Code Review

Documents

• Test Execution

Documents

• Training Plan/Materials

• User/Tech/Train

Manuals

• Acceptance/Implementation

Plan

• Approvals

• Requirements

Specifications

• Functional

Specifications

• System Design

Specifications

• Traceability Matrix

• Source Code

• Executable Code

• Training Materials

• User/Tech/Train

Manuals

• FAT Documents/

Reports

• IQ, OQ, PQ Protocols

• Integration Test

Documents

• Approvals

• IQ, OQ, PQ Reports

• Traceability Matrix

• User/Technical Manuals

• Training Materials

• Disaster Recovery

Plan

• Vendor Quality

Management Plan

• Validation Report

• Production Installation

Turnover Plan

• Post Implementation

Plan

• Approvals

• Periodic Review

Report

• Change Request/

Implementation Reports

• Document Supplements

• Maintain Training

• System Retirement

• Approvals

Copyright QACV Consulting, LLC_2015

Network qualification Servers Lines, Routers, etc.

Data Migration Interfaces

Data Migration as well as ongoing use interfaces Schedules from other groups

Implementation i.e. Inventory completed

Marketing Launch schedule

Other support personnel Testing personnel Training personnel

Identifying Validation Dependencies

Copyright QACV Consulting, LLC_2015

Data Migration

Migration Process Planned

Defined

Documented

Cleansing

Formatting

Conversion

Testing

Production Testing

Statistical Analysis

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Requirements

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Requirements

Requirements are the foundation for your implementation and validation efforts.

Requirements are the most critical aspect of your implementation for they will

determine all aspects of the project from timeline to infrastructure to validation to

testing to maintenance!!Copyright QACV Consulting, LLC_2015

The cost to fix an error is generally 200 times more expensive in work or resources as compared to fixing it before implementation.

Requirement errors account for 40-60% of defects in software.

“Requirements engineering is where the informal meets the formal”

Requirements should be detailed enough so that designers know what to build and those developing the tests know what to test.

Requirements

Copyright QACV Consulting, LLC_2015

One study revealed that for the successful projects, 28% of the project resources were spent on requirements. Furthermore 38% of the schedule went to requirements.

NASA projects that spent more than 10% of their total resources in the requirements phase, finished sooner and had lower costs compared to those that did not.

European study indicated that faster projects dedicated 14% of their efforts on requirements and 17% of the schedule, as compared to slower projects only committing 7% of their efforts and 9% of the schedule.

How Long Does It Take To Develop Requirements?

Results from summaries in Software Requirements by Karl Wiegers.

Copyright QACV Consulting, LLC_2015

Basic Requirement Categories

Essential If these are not met then the system will not be

accepted. Core functionality, security, regulatory compliance, etc.

Desired (but not essential) Having these would be great and may even have a

large impact on the process being automated, but are not essential to the success of the project. Process improvements, personal preferences, etc.

Copyright QACV Consulting, LLC_2015

Business process High level objectives for the business process being

automated User What the user will be able to do with the system

(typically focused on system/user interactions) Functional Specific behaviors the system must exhibit

Non-functional External interfaces, design constraints, quality

attributes, implementation constraints, etc.

Levels of Requirements

Copyright QACV Consulting, LLC_2015

Characteristics of good requirements Complete

Consistent

Necessary

Accurate

Testable/Verifiable

Traceable

Unambiguous

Valid

Requirements

Copyright QACV Consulting, LLC_2015

Group effort

All key stakeholders involved/represented

Diagram current and proposed process

Case studies

Workshops

Questionnaires

How to Gather Requirements

Copyright QACV Consulting, LLC_2015

Develop a numbering scheme AT-1… AT-2…

AT-2.1… AT-2.2…

SEC-1…

Requirement development is a group effort with stakeholder involvement

Requirements should be approved and changes managed Change management process should be formal Changes are okay if they are controlled Change can affect scope, pending work, completed work,

timeline, cost, etc.

Managing Requirements

Copyright QACV Consulting, LLC_2015

When are you “done”?

Can’t think of any more requirements within the scope of the project

New use cases are just another alternative to derive requirements that have already been captured.

Stakeholders start to repeat issues previously discussed

A gap analysis of the areas that needed to be addressed shows all concerns are documented.

Completing Requirements

Copyright QACV Consulting, LLC_2015

Inspect the requirements for the attributes they are supposed to possess

Inspect the requirements for the attributes they are not supposed to possess such as design details, implementation details, project deadlines

Checklists are often helpful

Completing Requirements

Copyright QACV Consulting, LLC_2015

“In the air, braking is not allowed, but a safe landing obviously requires brakes. To ensure that pilots did not inadvertently engage at A320 braking system, the software required that the wheels detect the full weight of the airplane. However, when a Lufthansa pilot attempted to land in Warsaw on a wet runway in high winds, the system did not detect the full weight of the plane on the wheels…the spoilers, brakes and reverse thrust were disabled for up to 9 seconds after landing in a storm on a waterlogged runway, and the airplane ran off the end of the runway …resulting in injuries and, loss of life.”

Complete Requirements?

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Risk

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

GAMP

Lifecycle approach

Phased to Project Management and Validation Process

FMEA

Quality Tools

Six Sigma

Tools for Evaluation

Copyright QACV Consulting, LLC_2015

Do not document for documentation sake (i.e. to make the validation stack bigger and weigh more)

Improperly implemented documentation can add risk to your project Poor requirements Blanket procedures that apply to all situations without

regard to risk Lack of key documentation

Make your documentation meaningful and every word count

Can Documentation Add Risk?

Copyright QACV Consulting, LLC_2015

Feasibility Stage

Is

Validation

Required

?

User

Requirements

Specification

Response to User

Requirements

Specification

Supplier

Assessment and

Purchase

Functional Spec

and Design

Test System

Validated System

Change Control

Determine Scope

of Validation

Document Justification

of Validation Approach

Update Validation

Plan

Develop Test

Plans

Decision

Documented

No

Yes

R

R

R

R

Validation ActivitiesProject Implementation Activities

Risk Assessment and

Validation Process, GAMP 4

R

Copyright QACV Consulting, LLC_2015

Identify the system Identify hazards and

possible harms

Risk ManagementRisk Analysis

Risk Evaluation

Risk Mitigation/Control

On-going Evaluation

Estimate, justify and document risk level(probability/severity)

Estimate costs of mitigationvs. non-mitigation

Define and take actions for mitigation

Monitor for new harms Monitor risk levels Update plan and take

actions

Risk

assessm

ent

Key criteria: product quality (public health), business continuity

ISO 14971-1:1998

Copyright QACV Consulting, LLC_2015

Start with a Process Flow Chart

Determine potential risks of the process relative to intended use

List critical control points for each identified hazard

List critical limits for each of the critical control points

List procedures used to monitor each of the critical control points

Risk Assessment

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Testing

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Test scripts provide documented evidence that you have tested the system against your requirements.

The scripts may be called for to demonstrate your overall validation efforts or to demonstrate that a specific function is performing as anticipated.

How Your Test Scripts May Apply in an Audit

Copyright QACV Consulting, LLC_2015

No - test scripts may be designed to fit the type of qualification testing but can contain similarities

They should be traceable

Vendor’s or developer’s specifications (equipment, environmental, etc.) (IQ)

Functional requirements (OQ)

Routine business process(es) (PQ)

Are All Test Scripts the Same?

Copyright QACV Consulting, LLC_2015

Pass, fail, yes, no, as expected, true, and false are not and never will be objective evidence. They are conclusions and are conclusions made based on what one believes the objective evidence shows.

“Objective evidence is data that shows or proves that something exists or is true. Objective evidence can be collected by performing observations, measurements, tests, or by using any other suitable method.”

Objective EvidenceKey to Testing

ISO’s Plain English definitions

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV Maintenance

Change Control

Periodic Review

System Retirement

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

Validation is just one part of the system’s lifecycle. The maintenance phase ensures the system stays in a validated

state.

The Maintenance Phase

Copyright QACV Consulting, LLC_2015

User/System log

Change control

Ongoing training needs to ensure continued compliance

Periodic review

The Maintenance Phase

Copyright QACV Consulting, LLC_2015

System User Log - for documenting all uses of the system.

Error/Incident Log - All system errors/incidents are to be recorded on this log, whether software or hardware, and each problem should be reviewed and its impact and resolution assessed.

System Operation Log - is used to describe any system level activity such as backup, software installation, software change, etc.

Maintenance/Repair Log - is for noting any type of maintenance or repair performed on the system.

Use/Issues/Maintenance Log

Copyright QACV Consulting, LLC_2015

Change Control

The only thing constant is change.

- Anonymous

Copyright QACV Consulting, LLC_2015

Know Everything at Any Time

SV04

SV03

DH08

SV02

`

SV01

Bench 1 Bench 2

Review

Clients

Bench 3

DH09

DH08DH03

DH02

DH01

DH05

DH06

DH07DH04

N01N02N04N05N03

WANNetwork

05

CS01 CS02

SD FIBER

GB-Ethernet

100BaseT

`

CORE

ACCESS

DISTRIBUTION

• Equipment Hardware

• Computer hardware

• Network components

• Operating systems

• Application software

• Specifications

• Validation status

• Documentation

Slide – courtesy of L. Huber, www.labcompliance.com

Copyright QACV Consulting, LLC_2015

Develop and implement SOP on change control

Describe who can initiate a request, evaluate and/or approve a request

Describe who can implement a change, what are the testing requirements, and what should be documented

Change Control ProcessPlanned Changes

Copyright QACV Consulting, LLC_2015

Hardware defects

Software defects

Emergency situations

Timing critical for business continuity

Consider request and release approved by two senior network administrators

Full approval afterwards

Emergency situations only

BE SURE TO DEFINE

Change Control ProcessUnplanned Changes

Copyright QACV Consulting, LLC_2015

Periodic Review

A critical part of your Quality Assurance Program and should be part of every IT

program.

Copyright QACV Consulting, LLC_2015

An evaluation of the system to ensure its adequacy to perform its designated task(s),

compliance with current standards and industry trends,

and assurance the testing and associated documentation still supports the systems current use.

Frequency In conjunction with a major change to the system (event

driven)

At a predefined time period - recommended not more than every 36 months (time driven)

Periodic Review

Copyright QACV Consulting, LLC_2015

Examines several key areas: Business Process Requirements Design Changes/change control Current system performance User load Procedures and standards System backups Testing (IQ, OQ, PQ) supporting the validated state Archival/availability of system related documentation

Periodic Review

Copyright QACV Consulting, LLC_2015

System Retirement

System Retirement is another important element of the Maintenance Phase

Data is key here as it will drive what happens to the system in the retirement process.

Copyright QACV Consulting, LLC_2015

The validation process encompasses the full lifetime of a system from installation to retirement.

Retirement formally closes the use of the system and ensures any records and data are available, as appropriate.

Two major steps to retirement Retirement Plan

Retirement Summary

System Retirement

Copyright QACV Consulting, LLC_2015

Identifies the system (name and version) Identifies the hardware and software components to be

retired Outlines the method for deactivation, removal, or re-

assignment of the system Identifies all involved parties and others that should be

notified of the retirement Addresses the preservation of data, records, etc. Outlines system-specific procedures that should also be

retired The retirement plan should be a formal approved

document

Retirement Plan

Copyright QACV Consulting, LLC_2015

Signals the completion and acceptance of the retirement activity

Summary of the outcome of deactivation and removal

Date the retirement was complete Be sure to include the “cleansing” of the server(s)

Actual disposition of the retired records

Any deviations from the Plan

Should also be an approved document

Retirement Summary

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Training

Key Issues

Additional Information

Copyright QACV Consulting, LLC_2015

System implementation and validation is a lot to handle. Do not assume everyone knows how to do it.

Before, during, and after the validation people need to be trained. But what are the basics of good training?

Training

Copyright QACV Consulting, LLC_2015

Who Gets Trained

EVERYONE!!

Start with Management

Copyright QACV Consulting, LLC_2015

Plan, Plan, Plan

Establish objectives

Design training

Prepare materials

Determine size, seating

Reserve the space

Notify participants

Elements of Training

Copyright QACV Consulting, LLC_2015

Conducting Rehearse, Rehearse, Rehearse Room Setup Watch Time Train-the-Trainer

Adult learning principles Use humor Use brainstorming Use visuals Use vocal variety Use meaningful gestures Do’s & Don’ts Handling a class

Elements of Training (2)

Copyright QACV Consulting, LLC_2015

Documenting

Name of course

Date & Time of course

Length of course

Description of course

Name & Signature of Trainer

Names & Signatures of Attendees

Elements of Training (3)

Copyright QACV Consulting, LLC_2015

Follow-up strategy Feedback Reference Materials Newsletters Table Toppers Department/Safety Meetings Measure & Monitor Performance Peer Audits Current Events/Bulletin Boards Contests

Elements of Training (4)

Copyright QACV Consulting, LLC_2015

Agenda

Why CSV

FDA & CSV

Part 11

Elements of CSV

Key Issues Compliance

Validation

Additional Information

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Training

Procedures

Data migration

Archiving

Documentation

Record retention

Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Training

Procedures

Data migration

Archiving

Documentation

Record retention

Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Audit Trails

Identified to Predicate Rules

Confirmed during testing

Reportable

Permanently linked to record –confirmed during testing.

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Copies of records

Inadequate Procedures

Data migration

Archiving

Record retention

Computer System Validation –Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Record Linking

Unbreakable links for predicate rule requirements

Reportable through the linkage

Electronic signature component to actual record (encrypted)

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Copies of records

Inadequate Procedures

Data migration

Archiving

Record retention

Computer System Validation –Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Copies of Records

Required by predicate rule

Must include all links and signature components

Ideal

Exportable to Industry Standard Format (PDF)

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Copies of records

Inadequate Procedures

Data migration

Archiving

Record retention

Computer System Validation –Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Inadequate Procedures

Include as part of UAT/PQ

Trained

Documented

Competence

Usability

Complete

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Copies of records

Inadequate Procedures

Data migration

Archiving

Record retention

Computer System Validation –Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Data Migration

Migration Process Planned

Defined

Documented

Cleansing

Formatting

Conversion

Testing

Production Testing

Statistical Analysis

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Copies of records

Inadequate Procedures

Data migration

Archiving

Record retention

Computer System Validation –Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Archiving

Planned as part of implementation

Record Linking

Signatures

Data

Record Recovery

All pieces visible

Copyright QACV Consulting, LLC_2015

Audit trails

Record linking

Copies of records

Inadequate Procedures

Data migration

Archiving

Record retention

Computer System Validation –Key Compliance Issues

Copyright QACV Consulting, LLC_2015

Record Retention

Requirements

Regulatory

Legal

Corporate

How

Electronic Media

Paper

?????

Copyright QACV Consulting, LLC_2015

Requirements

Design Control

Testing

Change Control

Traceability

Monitoring

Key Validation Issues

Copyright QACV Consulting, LLC_2015

ApproachWhere do you begin?

Copyright QACV Consulting, LLC_2015

IFYOUW

OULDJUS

TTELLMEW

HATTODOTH

ENIWOULDNOTH

AVE TOTHINKATALL

Copyright QACV Consulting, LLC_2015

Understanding the principles Knowing the requirements Knowing the governing regulations Establishing the risk

Detailed application Becomes a matter of rational trial and error Document, Document, Document Don’t take shortcuts Do “Lessons Learned”

Evaluate, Evaluate, Evaluate

Right Things in Focus

Copyright QACV Consulting, LLC_2015

Questions

Copyright QACV Consulting, LLC_2015

Thank You

[email protected]

Copyright QACV Consulting, LLC_2015