Webinar: DevOps challenges facing QA

PowerPoint Presentation

DevOps challenges facing QA

Webinar Presenters:Garry HeonBrian Le Suer

Gary and Brian give intros on themselves.3

AgendaWhat is DevOps?ChallengesMetricsToolsResources & SkillsetsIntroduction

Read the Agenda

4


Read the Agenda

5

Worlds 2nd Largest Independent Testing Company

QualiTest recognized for the past 3years as the only visionary pure play QA and Testing Services Company in the Magic Quadrant

About QualiTest Group

6

About ZeenyxCreators of AscentialTest, the award-winning testing solution for Windows, Web, dotNet, Java, PowerBuilder, Terminal and PDF

Committed to reducing the cost of software testing by making testers more productive

7


Read the Agenda

8

What is DevOps?Born from Agile software development and the need to keep up with the new software velocityIts combined with the understanding of value of collaboration between organizations throughout all stages of developmentThe increased importance of operations in the SAAS world has driven the need for innovation on the systems sideAs its name suggests, DevOps is a combination of software development,QA and operations disciplinesDevOps recognizes the interdependence of the groups

What DevOps is not?DevOps is not Development taking over OperationsDevOps is not just cultureDevOps is not just toolsDevOps is not just Development and Operations


Read the Agenda

11

ChallengesAlignment of development,QA and operations perspectivesLearning new skillsFrequent code changes must be tested quickly Automation suites must be resilient to application changesHaving the ability to automate in sprintNon-automatable tests must be integrated into the test cycle (exploratory, Ux, usability testing)Maintaining a developer toQA ratio that delivers consistently

Addressing the QA ChallengesUser stories are available and clearly defined before the sprint open/close meetingMock-ups/HTML of the UI design are made available to Dev andQA team at the same timeTesters must design their automation test case using mockups (pseudo code and/or the layout of the keyword)When Development completes UI integration, DOM elements are available forQA to complete the test case

Addressing the QA ChallengesTesters work closely with DevelopmentWhen the Xpath or the identifier of a page object is available,QA can make changes immediatelyPage object identifiers/Xpaths must be implemented so that all page objects are defined uniquelyAn appropriate automation test suite should be identified and plugged into the continuous integration pipeline


Read the Agenda

15

ResourcesNeed to maintain a good developer toQA ratioQualiTesters are finding the most successTest resources that are well rounded who can analyze requirements, automate test cases and execute them manually when neededSDETs find the transition easiestQA engineers are well-versed with technology, tools and processCI/CD, AgileBamboo, Jenkins, Git/TFS, Automation frameworks, AWSKeep up-to-date on trending technologies related to DevOps

ResourcesQA engineers need to be empoweredQA engineers need to communicate clearly during scrum meetingsQA engineers need to hold other team members (Dev, Ops) accountable to commitmentsQA engineers need to facilitate collaboration within the teamsQA engineers must address issues immediately


Read the Agenda

18

Requirements for an automated testing solution in an Agile/DevOps environmentFrequent code/component changes means that:

Tests must be executed frequently so that defects can be traced directly to most recent changes Tests must be resilient to application changesTests must be built using tools and approaches that makes it possible to update tests quickly and easily

AscentialTest Integration with Version ControlAscentialTest provides integration with version control to facilitate collaboration:Teams of people modify integrated test componentsTest projects must compile and be ready to execute at all times

AscentialTest version control integration:Check-out/check-inUpdate projectMerge changesVersion history

AscentialTest Integration with Build SystemsAscentialTest provides integration with build systems so that tests can be executed automatically on demand:

AscentialTests command line provides a mechanism to checkout the latest version of tests to target test machinesAscentialTests execution engine is accessible from the command line to allow tests to be run directly by the build systemAscentialTest report generator is accessible from the command line so that reports can be generated at the conclusion of a test runZeenyx Portal makes test results and reports available to the entire organization from any web browser

Rapid Test Development and MaintenanceAscentialTest AppObjects insulate tests from changes in the applications GUIAppObject definitions provide a single point of changeIf an application object is modified, only the AppObject definition needs to be updated. No changes to tests are required.

AscentialTests Step-based TestsTests are built with reusable components called steps that speed up the test creation process and reduce the maintenance effort when the target application changes.If application logic changes, only impacted steps need to be modified. Tests that implement those steps do not require any maintenance.


Read the Agenda

27

DevOps MetricsMetricDescriptionChange VolumeHow many user stories/fixes are being deployed.Change Lead TimeWhen commitment is made to business -> production.QA Lead TimeThe time from when the code is committed to when its deployedChange Failure RateHow many defects does a change introduce into the systemProduction DefectsNumber of defects found in productionHotfix/Rollback Production DefectsNumber of defects found in production that require a hotfixMTTR (Rollbacks)When a failure occurs how much time does it take to roll backMTTRWhen a failure occurs how much time does it take to recover (Hotfix)Number of Hotfixes/RollbacksNumber of hotfixes deployed over timeDeployment FrequencyHow often is new code being deployedTime to deployTime to deploy new codePercentage of Failed DeploymentsPercentage of deployments had issuesAvailabilityOverall uptime of the system

[email protected]@zeenyx.com

Thank You!

www.QualiTestGroup.com

Technology

Webinar: DevOps challenges facing QA