G O D D A R D S P A C E F L I G H T C E N T E R 1 Code 300 Orientation Code 302: Institutional Support Office November 16, 2010 Name: David Campbell Title:

G O D D A R D S P A C E F L I G H T C E N T E R 1

Code 300 Orientation

Code 302: Institutional Support Office

November 16, 2010

Name: David CampbellTitle: Deputy Chief, Institutional Support OfficeTel: 301-286-9343Email: [email protected]

--a


Outline

• Organization • Organizational Charter• Code 302 Business Operations• Policy, Products, and Services

– Supply Chain– Code 300 Training /Education Series– Gold Rules– Goddard Environmental Verification Standard (GEVS) Management– Goddard Problem Reporting System (GPRS)– Mission Operations Assurance– Configuration Management– Management System Policy– Internal Audit Program– Lessons Learned

• Backup Charts


Code 302 Institutional Support Office

*Contractor

SMA Configuration Mgmt

*Rhonda Weaver/ARTS*Benjamin Cripps/ARTS

Michael P. KellyOffice Chief

Dave CampbellDeputy

Cathie BowerProgram Support Assistant

Mission Ops Assurance / Anomaly Management

James La*Jim Suraci/MSEAT*Nicole Smith/MSEAT*Gary Jordan/HTSI

Environmental Test Verification / Problem Reporting Systems Analysis

Scotty Milne

NASA/HQ OCE Support

G.S. Krishnan (Detail to HQ)

GSFC Management System / Internal Audit

Kimberly Jenkins*Mark Bollard/HTSI*Donna Jackson/MSEAT*Jay Garvin/QARMS

Lead Systems Engineer

*Tom Clifford/MSEAT

GOLD Rules Management /Lessons Learned

Jerry Kosko

Supply Chain Management

Louis ThomasCharles KimJonathan RootMatthew Fox*V. DiMarco/MSEAT

10/14/2010


Institutional Support Office - Code 302 Services

•Leads the GSFC Management System, Internal Audit, and Supplier Assessment Programs

•Performs Mission Operations Assurance (MOA)

•Manages Goddard Environmental Verification Standard (GEVS)

•Manages Goddard Open Learning Design (GOLD) Rules

•Provides Configuration Management for Safety & Mission Assurance Directorate's (SMA-D)

•Assesses NASA Headquarters' Office of Chief Engineer (OCE) initiatives

•Manages SMA-D seminars, training, and outreach initiatives

•Manages internal control program for the GSFC institution and projects

•Supports the Center-wide Laboratory Manager Program

•Supports production of annual Safety and Mission Assurance Annual Operating Agreement

Figure 1

Code 302 Business Operations

Institutional Support OfficeFunctions

• Supply Chain Management

• GSFC Management System / Internal Audit

• SMA-D Configuration Management

• Mission Operations Support / Anomaly Management

• Environmental Test Verification / Problem Reporting Analysis

• GOLD Rules Management

Mission Operations GSFC Flight Projects GSFC Management System Representative

Directorate MSCRepresentatives

GSFC Directorates

Code 300 Management

Code 302Branch Chief

Code 250

Center Management

HQ OSMA

NASA Centers

NASA Contractor / SupplierCommunity

CSOs

GPRS Users

Engineers – GEVS / Rules

CPRA Users

• Supply Chain Assessment Schedule

• Supplier Conference• GSFC Project Supplier Listing• Supplier Assessment Database• Supplier Assessment Plans• Supplier Assessment Reports

• GOLD Rules Documents• GOLD Rules Website• Waivers / Dispositions

• Outreach / Inreach• Customer Relationships• Speaking Engagements

• Anomaly Assessment Reports• Risk Assessment Reports• SOARS Statistics / Metrics• SSMO Top “n” Risk List• Lessons Learned

• Internal Audit Schedules• Internal Audit Plans• Internal Audit Reports

• GEVS Management• GPRS Management• CPRA Inputs / Charts• Special Assessments

• Code 302 Pre-MSR Briefing• Code 300 MSC Charts• QSR Charts• Code 300 QED Charts• Directive Reviews

• ISO / AS Training• Statement of Assurance Package• Process Improvement / Training• Process Maps / Matrices

• Branch Chief Requests• 302 Personnel Requests• PR Requests• Auditee / Customer Surveys• Project CSO Requests

• Supplier Listing Updates• Supply Chain Assessment Requests• Assessment Priorities• Draft Assessment Plans / Reports• NAMT Opportunities• Supplier Corrective Actions

• CSO Weeklies• 300 Pre-MSR• SOARS Metrics• SOARS Statistics

• SMA-D Related Waiver Requests• Draft Directives• Project GPRS Entries• Flow-down Test Requirements

• Internal Audit Requests• Internal Audit Results• GSFC Corrective Actions• GSFC MS Requirements• HQ MS Flow-down Requirements

Inputs

Products

Customers

• CM Requirements• DM Requirements• CM/DM Systems


Protecting the Public, Astronauts and Pilots, the NASA Workforce, and High-Value Equipment and Property

GSFC Supply Chain Quality Assurance Program

Louis Thomas/GSFCCharles Kim/GSFC

Jonathan Root/GSFCMatthew Fox/GSFC

Tom Clifford/SRS/MantechVic DiMarco/SRS/Mantech

-


Supplier Assessment Program

• Conducts Supplier assessments

• Maintains Records of assessments in GSFC audit database

• Sponsor Quality training (e.g. AS9100 quality system, ISO Lead Auditor)

• Sponsor The Supply Chain Conference

• Technical Liaison for NASA Contract Assurance Services (NCAS)

• Focal Point for Defense Contract Management Agency (DCMA)

• Working with the NASA Assurance Management Team (NAMT) – all NASA Centers Participation

• Working with the Joint Audit Planning Committee (JAPC) – Primes and other Government Agencies (NASA, MDA, NRO, and DCMA)


Assessment Objectives

Assess the supplier’s processes for compliance to:

the requirements of ISO9001:2000 or AS9100, (if supplier is third party certified, we will assess the supplier to it.)

the applicable NASA Contractual Requirements, and

the requirements of the internal Quality Management System.

Follow up on previous NASA assessments

The goal of each assessment is to identify strengths and areas for improvement.


The following list provides an outline of “some” of the topics the assessment

team will review:

• Flowdown of contractual requirements

• Receiving inspection

• Configuration Management / Change Control

• Nonconforming product control

• Rework and repair processes

• Parts sampling, selection, and traceability

• Training and Certification of operators/

inspectors/disposition authorities/testers

• Process documentation adequacy (work

orders, shop aids, drawings, etc.)

• Document control

• Workmanship and inspection• Travelers, routers and configuration recording

• Packaging

• Scrap control

• Handling

• Acceptance Data Packages

• Problem Reporting System

• Internal Audit

• Calibration

• GFE

• Industrial Safety

• System Safety

• GIDEP

Sample Assessment Plan “items to be reviewed”


Projects Supported – Jan 2007 - Sept 2010

0

10

20

30

40

50

60

Quantity of Assessments vs Project


Supplier AssessmentsFY 2010

~ Locations

= ~Assessment Location

Assessment in Sweden not shown

Safety and Mission Assurance Directorate, Goddard Space Flight Center

Supply Chain ManagementSupply Chain 2010 4th Annual NASA Supply Chain Quality Assurance Conference

October 20-22, 2010 @ NASA Goddard Space Flight Center

• Successful conference focused on Innovation and Mission Success– 19 topics and 29 speakers plus Space Industry Supplier Social, tour of Goddard facilities and

new seminar on Business Process Management• Record turnout of 235 leaders and practitioners (21% increase from prior year) from aerospace

industry, suppliers, NASA and other agencies• Highly positive feedback, including:

– “I was impressed with the variety of attendees including VP and director level individuals. It shows the level of commitment to quality coming both from NASA and its supply base. ”

– “Appreciate warm welcome from NASA staff”– “One of the best managed conferences I have ever attended.”– “Great networking and customer engagement opportunity.”– “Social event was excellent for developing new contacts.”– “Great variety of presentations/speakers.”– Great Conference. Very informative and well-planned.”– “Excellent Conference. Several ideas for improving our site … will be implemented.”

• Feedback and lessons-learned will be used in planning Supply Chain 2011 next fall.• Conference presentations available at http://supplychain.gsfc.nasa.gov• Hosted by the Institutional Support Office / Supply Chain Management Team, Safety and

Mission Assurance Directorate, GSFC

(10/26/10 )


Introduction to AS9100 Class at GSFC

• Civil servants and contractors are invited to attend a class presenting the requirements of GSFC Management System, Aerospace Standard AS9100 and ISO 9001/2000.

• Class is presented by Institutional Support Office (ISO)

• The course is an in-depth overview of requirements, organization, structure, and use of the Quality Management Standard (agenda is available per request). For more information, Contact Donna Jackson, 301-286-1240, [email protected]

• The objective is to give the student a working knowledge and auditing skills of the International Organization for Standardization (ISO) Quality Management Standard (QMS) for the year 2008 and AS9100 Aerospace requirements rev C., and to familiarize the student with the GSFC Management System.

• The room can accommodate 25 persons and spaces will be reserved on a first-come, first-served basis.


ISO 9001:2008 Internal Auditor Training

• Location: Bldg 1, Room 008

• Course Outline:

– Provides students with an understanding of an internal audit program and the knowledge and skills needed to carry out successful internal quality management system audits.

– Students will become familiar with the four-phases of an audit that includes audit:

• Preparation

• Performance

• Reporting

• Follow-up

• The mechanics of an individual audit and auditing techniques are presented and are reinforced using case studies and practical exercises.

• Students will work in teams to actually develop audit checklists, perform a practice audit, and report on results.


Lead Auditor Class at GSFC• The class is sponsored by the Institutional Support Office

• Presented by Plexus Corporation

• The course provides either new or current aerospace auditors with an understanding of the AS9100 standard, the process approach of ISO 9001:200, and how the process approach impacts auditing practices. The course includes a simulated audit to develop and refine newly acquired knowledge and skills including the application and evaluation of a process based quality management system. A successful completion of Plexus Corporation’s program meets the training requirements for certification of individual QMS Auditors and Aerospace Auditors.

• The class can accommodate 10 persons.

• Where: Goddard Spaceflight Center or vicinity.

• First class occurred: May 19 - 23, 2008

• Another class is planned for all Directorates personnel. Date is TBD.


Training and Outreach Activities• GSFC / SMA-D Education Series

– Presentations sponsored by SMA-D in support of communication and outreach initiatives identified in NASA's Strategic Plan

– Fosters a greater understanding of key NASA activities, functions, and processes.

• 1st session: Bryan O’Connor presented "Quality & NASA" on July 28, 2008.• 2nd session: Gregory Robinson presented “Systems Engineering with Quality” on

September 30, 2008. • 3rd session: Michael Blythe presented NPR 7120.5 D, “Program and Project

Management” on January 9, 2009.• 4th session: John Lyver presented “SMARTS” Database on Feb 18, 2009.• 5th Session: Aerospace Chief Engineer, Bill Tosney presented “Mission Assurance; An

Industry Perspective” on April 14, 2009• 6th Session: GSFC Procurement (S. Shaw and T. Stevens) presented “Procurement &

Quality” on Sept. 22, 2009.• 7th Session: ESD Stress Levels; Their Origin and Application, Jose Sancho presented on

Nov. 17th, 2009.• 8th Session: Capturing GSFC Lessons Learned, Ed Rogers presented, 17 Feb. 2010


Training and Outreach Activities (continued)

• 9th Session: SOARS, Nicole Smith presented, 01 April 2010,(1st time offered via WebEx)

• 10th Session: Transition to J-STD-001DS; A Guide for Implementation, Jeannette Plante presented, 25 May 2010

• 11th Session: GOLD Rules; Their Purpose, Application, and Technical Authority, Scott Glubke presented, 14 July 2010

• 12th Session: “New Business; Why GSFC Gets New Work”, Bill Cutlip presented, 01 Sept.2010. (Special emphasis was placed on Code 300’s involvement.)

• 13th Session: “PRA from an RIDM Perspective”, Tony Diventi presenting 08 Nov. 2010, 10:30a-12:00p, Bldg 8 Auditorium


• SOARS Primer

– A formal and/or self-taught training package divided into 9 modules.

– Modules 1-6 are designed to familiarize Flight Operation Team members on the use of SOARS.

• The topics covered include: Introduction, My SOARS Page, My Profile, Searching SOARS Database, Adding Reports to SOARS Database, Updating/Closing a SOAR.

– Modules 7-9 are tailored for Spacecraft Administration.

• The topics covered include: Mission Creation, Mission Configuration, Mission Users.

• Audit/NCR System Nonconformance Lead (NCL)

– Designed to familiarize NCLs with navigating the system, updating/closing Nonconformance Reports (NCRs), and system functionality such as “My Actions”.

– Included in this course is an online review of the Audit/NCR System and navigation through the database.

– Present NCL’s the information necessary to determine appropriate root causes and address the root causes of an NCR.

– Provided periodically throughout the year and is usually conducted in the Computer Training Facility in Bldg 1, although one on one sessions can also be delivered.

Training & Outreach, cont.


• So, You Are Going to Be Audited– This course is designed to help potential auditees understand their

responsibilities when being audited and familiarize them with the Goddard Management System (MS).

– Included in this course is an overview of the GSFC Quality Standard, currently ISO9001:2008, Goddard Directives Management System, GDMS, identifying how to locate applicable GSFC Directives (GPR’s) Directorate Procedures (PG’s).

– The course also delivers a high-level review of the GSFC Quality Manual and Quality Policy.

– Provides information to an auditee on the appropriate ways to respond to an auditor, including a list of do’s and don’ts.

– This course is provided to organizations that have been scheduled to be audited. It can also be delivered to individual audit points of contact as appropriate.

Training & Outreach, cont.


• Lessons Learned Class was held June 15-16, 2010• A case study class that discusses lessons learned from NASA missions.

Class is open to all civil servants and contractors (Code 300 gets priority). Jerry Kosko is the point of contact for the class.

• New Training Session (per QAAR Action):

• ”Identification of Counterfeit Parts”

• Class is 8 hours duration.

• 1st set currently occurred Aug. 10th, 11th, 12th, 2010

• 2nd set occurred October 4th , 6th , 2010

• Very successful, with much positive feedback received

• Provided by experts from JPL

Education/Training/Outreach


GOLD Rules Function

• Provide independent GEVS compliance review; make revisions as needed

• Goddard Open Learning Design

– Rules for the Design, Development, Verification, and Operation of Flight Systems, (GSFC - STD - 1000)

– High-level subset of all the design rules required for safety and mission success for all space flight products regardless of implementation approach. All products shall be designed, developed, verified and operated in accordance with the GSFC Rules.

– Each "Gold Rule" includes a Principle, Rationale, and Activities and Verification by phase.

– Code 500 ‘owns’ the Rules.

– Code 300 hosts the server, performs Configuration Management; involved in all waiver approvals


GOLD Rules Website

• GOLD Rules are accessible online; URL: http://gsfcrules/


Goddard Environmental Verification Standard (GEVS) Management

• GEVS: GSFC-STD-7000

• http://standards.gsfc.nasa.gov

• Provides baseline environmental test program for all Flight projects.

• Work with projects in understanding requirements

• Reviews verification programs for compliance

• Consult with projects regarding test program issues or potential modifications or waivers to plan


Goddard Problem Reporting System (GPRS)

URL: https://gprs.gsfc.nasa.gov


Goddard Problem Reporting SystemGPRS

• The GPRS is a secure web-based system for reporting anomalies and non-conformances– Managed by Code 302– Developed and maintained by Code 700

• GPRS consists of several modules– NCR/CAS - Nonconformance Report and Corrective Action System for reporting and

processing audit findings (internal, supplier, external), process non-conformances, and customer complaints (customers are external to NASA)

– A new NCRCAS -Audit system replaced the current NCR/CAS– SOAR – Spacecraft On-orbit Anomaly Report system for documenting and processing

operational anomalies occurring with spacecraft or their ground systems. Sub-orbital missions (sounding rockets, balloons, etc.) are also required to use SOAR. [The name SOAR is a carry over from a previous system]

– PR/PFR – Problem Report/Problem Failure Report system for documenting problems occurring during the development phase. All problems are initiated as a PR and advanced to the PFR status if more diagnostics are required.

– Mishap –Mishap provides a link to the NASA IRIS system for reporting safety problems (mishaps and close-calls).

– S&E - Safety & Environmental system is used to document and process environmental issues. (a link to the NASA IRIS system is also provided)


Mission Operations Assurance Program

• GOAL: Compliance with NPD 8700.1 NASA Policy for Safety & Mission Success• Objectives:

– Provide solutions to continuously improve overall Center mission performance through out the its life cycle

– Provide mission assurance oversight and insight support to on-going projects– Provide in-depth analysis and management on project relevant Anomaly & Problem

data– Provide the stakeholder feedback on cross-project critical anomaly issues and

lessons learned – Assess mission performance through policy, data analysis, compliance verification,

validation, early intervention, and risk management– Assure the success of Center missions on an ongoing basis– Establish central database for Center missions anomaly reports– Participate Center Goddard Procedures and Guidelines (GPG) for conducting

anomaly investigations– Apply consistent practices regarding anomaly investigations


Configuration ManagementPolicy, Products, and Services

• Policy: GPR 1410.2 and 300-PG-1410.2.1

• Process and track documents through code 300 (i.e. GPRs, waivers, and internal documents).

• Maintain records of comments, version numbers, approvals, disapprovals, signatures, and timelines.

• Keep policies and procedures current.

• Help, support, and facilitate documents for Code 300.


CM Tool Cont’dURL: https://ossmacm.gsfc.nasa.gov/index.cfm


http://gsfcmanagementsystem.gsfc.nasa.gov

Management System Policy

http://gdms.gsfc.nasa.gov/

• NPD 1280.1, NASA Management System Policy– Delineates characteristics of a viable management system– Requires 3rd Party audit of management system– ISO 9001 or AS9100 certification satisfies the NPD

• NPD 8730.5, NASA Quality Assurance Program Policy– Requires AS9100 compliance for critical / complex hardware development

• GPR 1280.1, The GSFC Quality Manual– Outlines the GSFC management system, registered to ISO 9001.


What is ISO 9001?

• ISO 9001 is a set of requirements placed on an organization’s business system that puts a focus on product quality through process control

– AS9100 is the areaspace industry equivalent of ISO 9001, with some additional requirements

• At GSFC, the requirements of ISO 9001 and AS9100 are met through the set of processes called the GSFC Management System

– The Management System is our ISO 9001 certified and AS9100 compliant business system

– The Management System reflects the way we actually do our work

The GSFC Quality Manual, GPR 1280.1, outlines GSFC implementation of ISO9001

requirements.


The GSFC Quality Policy...

• The Management System includes a Quality Policy formulated by Center Management.

GSFC QUALITY POLICY

With Customer satisfaction as our primary goal . . .

GSFC is committed to achieve excellence in all our efforts,

Exceed our customers’ requirements, and

Continually improve our processes.

As referenced in GPR 1280.1C; The GSFC Quality

Manual


Internal Audit Program

• Conduct Internal Audits, including follow-ups of identified non-conformances

• Plan implementation activities toward achieving AS9100 registration.

• Develop and implement Root Cause/Corrective Actions (RCCA)

• Provide Training for GSFC Nonconformance Leads (NCLs).

• Implement new tools and processes for the annual Statement Of Assurance (SOA) activity.

• Maintain baseline SOA processes for GSFC with baseline performance measures.

• Integrate Organizational and Occupational Health and Safety Audits, when/where feasible


Internal Audit Schedule

Org Code Organization to Be Audited POC Bldg Date Lead Auditor Type of Audit

Complete / In-Work / Cancelled

554 Laser & Electro Optics Mike Krainak 33 1/5/2010 Mark Bollard Lab Audit - Consolidated Complete600 600 Labs Stan Wojnar 21 2/2/2010 Jay Garvin Lab Audit - Consolidated Complete546 Contamination and Coatings Randy Hedgeland 4 2/10/2010 Donna Jackson Lab Audit - Consolidated Complete403 Global Precipation Monitoring Bob Bridgers 3/15/2010 Bob Collier Re-Assigned as NQA Audit Complete210 Procurement Operations Mike McGrath Multi 3/26/2010 Mark Bollard Part of QAAR Assessment Complete273 Receiving/Inspection Gary Leganeaux 16W 5/6/2010 Mark Bollard Part of QAAR Assessment Complete554 Laser & Electro Optics Mike Krainak 19 5/18/2010 Tom Clifford QAAR (originally joint) Complete427 LDCM (follow Up) Bob Bridgers 5/26/2010 Tom Clifford Part of QAAR Assessment Complete762 Eng. & Security Services (700) Brad Torain TBD Jay Garvin Planning582 Flight Software Systems Charles Wilderman 23 6/29/2010 John Anders Part of QAAR Assessment Complete596 Component H/W Systems Chuck Glagett 11 7/7/2010 Mark Bollard Lab Audit - Consolidated Complete544 Electro-Mechanical Systems Armando Morell 5 7/14/2010 Donna Jackson Lab Audit - Consolidated Complete600 600 Labs Warren Connley 34 8/20/2010 Mark Bollard Lab Audit – Part of NQA Complete200 MOD/Customer Service Office Ray Rubillotta Bldg 8 8/25/2010 Tom Clifford Cancelled552 Cryogenics and Fluids Branch Susan Breon 7 9/10/2010 Donna Jackson Lab Audit - Consolidated Complete540 Lifting Devices Brian Montgomery Multi 9/18/2010 John Anders Cancelled 350 Occ. Safety and Health Armando Lopez Bldg 32 9/21/2010 John Anders Complete300 TOMS Jay Garvin Multi 9/24/2010 Jay Garvin Process Audit Complete 540 Calibration Felicia Donnell Multi 10/18/2010 Mark Bollard Process Audit Planning

452 SN Project - Ground (WSC) Bridgers / Shinners WSC 12/1/2010 Jay Garvin Cancelled322 Risk Management Tony Diventi Multi 10/25/2010 Tom Clifford Process Audit Planning800 WFF : 800/500/600 Regena Haugh Multi N/A Mark Bollard NQA Audit in September Complete

(10/27/10 kj)


• Code 302 coordinates the annual Internal Control assessment of GSFC institutional, programmatic, and financial functions resulting in the Annual Statement of Assurance for signature by the Center Director.

– Identify internal control process and responsibilities. – Integrate Internal Control inputs from Directorates into Center Certificate of

Reasonable Assurance Package.– Serve as a resource for Directorate/Organization internal control efforts. – Conduct periodic reviews of Directorate/Organization internal control

practices.

Management SystemInternal Controls

Directorateinputs

ISO (302) reviews responses for adequacy and potential weaknesses. Works with

organizations to complete responses, verify objective evidence, and assess risk.

ISO (302) integrates responses into Center perspective set of

responses. Prepares supporting documentation for MSC review and formal submittal/retention.

Management System Council reviews documentation and

provides recommendations to the Executive Council.

Executive Council reviews memo / documentation and meets to

endorse Certification of Reasonable Assurance.

Center Director signs and submits

Certification to HQ.


Code 302 Activities in Support the Office of the Chief Knowledge Officer (OCKO)

Represents GSFC on the NASA Lessons Learned Steering Committee

Preparing draft GPR for OCKO

Preparing Lessons Learned for NEN database

Lessons Learned

CONTINUED


Code 302 Activities

• Support OCKO forums and workshops

• Tentative agreement with Code 400 to generate Project related LLs

• Review new LLs as requested by HQ

• Support monthly Steering Committee telecons

• Support quarterly Committee meetings

Lessons Learned


Back up Charts

How to Obtain all NASA/GSFC Assessments Reports


GSFC Audit Database Linkhttp://auditsystem.gsfc.nasa.gov

Civil Servants Click here.

Non-civil-servants do not have access to Supplier records.


Civil Servants click here to request ‘Browse’ access to Supplier Audit records.

Current users click ‘Cancel’ to login with their current user ID.

Non-civil-servants do not have access and must ‘Cancel’.


Civil Servants complete the form to request ‘Browse’ access to Supplier Audit records.

Press ‘Submit Request’. This will send an email request to audit coordinator.

Audit coordinator will verify civil servant status, grant access and a notification email will be sent to requestor.

Civil Servants new users complete the form for ‘Browse’ access


Click here

GSFC Audit Database Link


Click here



Click here



GSFC Supplier Audit Database Link