Imagine the Change: Realizing the dream of …ilta.personifycloud.com/webfiles/productfiles/2111185/...Imagine the Change: Realizing the dream of practical and effective QA Presented

Imagine the Change: Realizing the dream of practical and effective QA

Presented by Alan Reeson, Denise Miller, & Bill Mertes

#APP8

August 19, 2014

Thank you for being here today

Presenter:

Alan Reeson QA Supervisor

McGuireWoods LLP is an international

law firm with more than 900 attorneys

in 20 offices in the United States and

Europe.

Alan Reeson has been with the firm

since 2001.

McGuireWoods LLP

Enterprise Architecture

To continuously improve and align the firm’s technology architecture in support of the firm’s strategic plan; and to increase the performance of IT products/services through sustained governance in aligning IT processes with established best practices.

To continuously improve and align the firm’s technology architecture in support of the firm’s strategic plan; and to increase the performance of IT products/services through sustained governance in aligning IT processes with established best practices.

Quality Assurance

Project Management

Business Systems Analysis

Information Security

Quality Assurance

Phase 1 - 2004

People 1 QA FTE,

Conscripted IT Staff

Integration Points

High Priority Projects

and Security Patching

Tools Templates (Word &

Excel)

DMS

Phase 1 - 2004 Phase 2 - 2006

People 1 QA FTE,


1 QA FTE, IT Volunteers

Integration Points






Excel)

DMS

Quality Center, templates, DMS

Phase 1 - 2004 Phase 2 - 2006 Phase 3 - 2009

People 1 QA FTE,



1 QA FTE, 6 Contractors

Integration Points





All Projects, Critical Non-

Project Releases, Process

Engineering


Excel)

DMS


Quality Center, Visio, templates

Phase 1 - 2004 Phase 2 - 2006 Phase 3 - 2009 Phase 4 - 2013

People 1 QA FTE,





Integration Points





All Projects, Critical Non-

Project Releases, Process

Engineering

All Projects, Non-Project Releases &

Changes, Process

Engineering


Excel)

DMS


Quality Center, Visio, templates

PPM, Quality Center, Visio, templates

McGuireWoods LLP Our Journey

Phase 1 - 2004

Challenges

Resistance to Change

Rework

Strategies Collaboration

QA Library

Phase 1 - 2004 Phase 2 - 2006

Challenges


Rework

Lack of consistency

Lack of

Resources


QA Library

Training

Relationship Management

Phase 1 - 2004 Phase 2 - 2006 Phase 3 - 2009

Challenges


Rework

Lack of consistency

Lack of

Resources

Contractor turnover

Resource

Management


QA Library

Training


FTE Conversions

Frequent Checkpoints

McGuireWoods LLP Challenges and Strategies

Phase 1 - 2004 Phase 2 - 2006 Phase 3 - 2009 Phase 4 - 2013

Challenges


Rework

Lack of consistency

Lack of

Resources

Contractor turnover

Resource

Management

Transparency

Optimization


QA Library

Training


FTE Conversions

Frequent Checkpoints

Reporting

Measurement

Performance

McGuireWoods LLP Next Steps

Automation Optimization

“Countless, Unseen Details Are Often The Only Difference Between Mediocre and Magnificent.”

QUALITY ASSURANCE

Presenter:

Denise Miller Sr. IT Project Manager

Hunton & Williams LLP is an international law

firm with more than 800 attorneys in 19 offices

across the United States, Europe and Asia.

Denise has been with the firm since 1996.

Hunton & Williams LLP Denise • 30 Years’ Experience in Legal Field

•1984 Small 3-Attorney Firm, Legal Secretary

•1985 Tennessee Valley Authority, Legal Secretary

•1988 Small 10-Attorney Firm, Litigation Paralegal

•1991 United States District Court, Deputy Clerk

• Hunton & Williams Career Began in 1996

•1996 H&W Professional Assistant

•1997 H&W Computer Support Assistant

•2002 H&W Systems Administrator

•2008 H&W IT QA Analyst

•2012 H&W IT QA Manager

•2014 H&W Sr. IT Project Manager

Together Everyone Achieves More

Hunton & Williams LLP

• 19 offices across the US, Europe and Asia

• Terremark Data Center in Culpeper, VA

• VMWare Shop with Hyper-V Deployment in progress

• Centralized DMS / Matter Centric Autonomy

• Windows 7 / Office 2010 / Exchange 2010

• Autonomy iManage DeskSite/ FileSite

• HBR FastFolders / FastFiler

• SharePoint (eHunt intranet)

• Client Workroom (extranet) / eRoom

• Citrix VPN

• Citrix Published Desktop and Applications



• April 2008 – QA Team

Practice Support Manager

QA Analyst

• December 2009 – QA Team

IT QA Manager

QA Analyst

• May 2014 – QA Team

Sr. IT Project Manager

Sr. QA Analyst

QA Analyst



The Quality Assurance team was tasked with

creating H&W IT QA best practice methods

supporting development of related documentation

ensuring adherence to established methods

managing QA SharePoint Site

providing weekly QA Schedule Report on QA

SharePoint site

providing monthly QA Project Status Reports on QA

SharePoint site

educating IT on QA



What is Software Testing?

• Testing involves operation of a system or application under controlled conditions and evaluation of the results. The controlled conditions should include both normal and abnormal conditions. Testing should intentionally attempt to make things go wrong to determine if things happen when they shouldn’t or things don’t happen when they should.

• Testing is oriented to “detection.”



What is Software Quality Assurance?

• Software QA involves the entire software development PROCESS • monitoring and improving the process; • ensuring that agreed-upon standards and

procedures are followed; and • ensuring that problems are found and resolved.

• QA is oriented to “prevention.”



Which is Better?

• Detection?

• Prevention?

• Quality cannot be tested into software (or a project). It can only be designed in (planned).



Defined Roles and Responsibilities

• Project Manager

• QA Analyst

• Functional SME

• Technical Lead

• Key Users and Testers



Outlined Rules of Engagement

• Effective Communication – key to success

• Realistic timeframes in planning

• While project is with development team, no testing will be performed

• While project is with test team, no changes to be made by development team



Timing of QA in Project

• When should QA begin?

• Considerations • Wait until testing phase begins – test cases will

be rushed • Recommended that test case development

begin in conjunction with application or system configuration documentation

• Resources



• Black Box Testing

• White Box Testing

• Unit Testing

• Incremental Integration Testing

• Integration Testing

• Functional Testing

• System Testing

• End-to-end Testing

• Sanity Testing

• Regression Testing

• Confirmation Testing

• Acceptance Testing

• Load Testing

• Stress Testing

• Performance Testing

• Usability Testing

• Install/Uninstall Testing

• Compatibility Testing

• Comparison Testing

• Alpha Testing

• Beta Testing

Types of Testing



QA Workstations


• QA desktops in each office

• QA laptops (each model)

• VMs


QA Best Practices Workflow


• Phase 1: Initiate QA project • QA Request • QA Team Assignments

• Phase 2: Determine Test Requirements

• QA Schedule • Draft QA Test Plan Approved by Project Team

• Test Types • Test Script ID




• Phase 3: Develop Test Plan and Test Script • Finalize QA Test Plan • QA Test Script

• Detailed step-by-step script • Automated scenarios, if any




• Phase 4: Perform Test Process and Remediation • Script testing • Exploratory testing • QA Issues List • Remediation • Regression Testing




• Phase 5: Close Out • Lessons Learned • Approval given to Project Manager, Change

Advisory Board, and/or Leadership Team • If applicable, changes to best practices

documentation







• Keep our technologies up-to-date

• Schedule delivery of updates on a recurring basis

• Improve our security patch process

• No open applications when patch is applied

• Improve the life-cycle planning, development, QA, and

delivery of such updates particularly as relates to the

communications and preparations

• Better engage IT Support Staff and end users to ensure

successful delivery and adoption of technology enhancements

• Establish a culture of user and IT staff discipline, support, and

adoption of technology updates

H&W Monthly Update Process – WHY?



• Monthly Minor Updates

• Microsoft Security Patches

• Issue fixes that can be applied by AppSense

• Quarterly Major Updates

• Microsoft Security Patches

• Issues fixes that can be applied by AppSense

• Vendor Updates

H&W Monthly Update Process










Process

People

Progress





“Quality involves living the message of

the possibility of perfection and infinite

improvement, living it day in and day

out, decade by decade.”

Tom Peters, co-author of In Search of Excellence



“In legal IT we will never attain

perfection; however, in our pursuit of

perfection, we will attain

Excellence.”

Me (Denise Miller)


Presenter:

Bill Mertes Director – Software Engineering

Bill leads Olenick’s Software

Engineering Practice, covering

software development and application

life cycle engagements. He is also co-

lead of Olenick’s Legal Vertical.

Prior to joining Olenick in 2009, he

spent 22 years at Winston & Strawn

LLP.

Olenick & Associates

• IT consulting firm / 250 consultants

• Major industries are Energy and Financial Services

• Core competencies include project risk reduction

• Project management

• Quality assurance / software testing

• Application lifecycle management

• 5 Years servicing legal firms / corporate law departments

• Develop / maintain ILTA’s Legal Systems Test Repository

O&A Legal Client Observations

• Very broad spectrum of QA maturity

• Corporations have much more process, which legal departments follow

• A few G50 clients have dedicated QA resources and processes

• Rest of firms are “getting by”

• Alternates

• Trainers

• User Support / Service Desk

• “In the Wild”

• QA Process

• Takes form of User Acceptance Testing

• No Formal Regression

• No Test Tooling

O&A Client Observations (cont)

• Growing group looking for “A better way”

• Regulatory obligations of clients are extending to their providers (e.g. HIPPA)

• Recognition that QA investment actually saves $$$$

• Measured approach

• Assessment

• First Step

• Initial hire focused on process (w/mentoring)

• Contractors for functional testing

• Tooling to support process

• Slow growth by adding resources

• More advanced Risk Reduction

• Automation

• Performance

We’ll now open it up for questions

Questions

Question #1

How do you represent the impact your

efforts make? Strictly qualified? Or do

you have a quantifiable method?

Question #2

How do you manage the “naysayers” who

primarily view your efforts as

unnecessarily slowing down projects?

Question #3

Can you provide a specific example of

where your services had an impact?

Question #4

Is there any special tooling you

use? What do you see as the base-line

technology to support your efforts?

Question #5

Are you primarily just doing manual

functional testing? Or do you also do

more advanced things such as

performance or automated testing?

Thank You

Alan - [email protected] Denise - [email protected] Bill - [email protected]

mailto:[email protected]



Documents

Imagine the Change: Realizing the dream of …ilta.personifycloud.com/webfiles/productfiles/2111185/...Imagine the Change: Realizing the dream of practical and effective QA Presented