Embed Size (px)
Citation preview
SIG Talk: Quality & Testing -
DevOps and Performance
Testing Powered by VoiceOctober 9, 2018
Future topics
If you are interested in participating as
a SIG Talk speaker for one of our 2018
Quality and Testing topics or want
to suggest a speaker or topic, please
take a moment to answer our survey.
Hosted By
Petar Puskarich
Bank of America
AVP, Performance Engineer
Performance Engineering SIG Leader
Today’s Speakers
Joe FriedrichsenManaging Director
BCBSRI
NaveenKumar NamachivayamPerformance Test Lead
Infosys Limited
House Keeping
• This “LIVE” session is being recorded
Recordings are available to all Vivit members
• Session Q&A:
Please type questions in the Questions Pane
Webinar Control Panel
Toggle View Window
between Full
screen/window mode.
Questions
Agenda
• Performance Testing Trend
• Bringing smart assistants
• Use cases and Pros
Performance Testing Trends
• Agile
• CI/CD
• Cloud
• IoT
• Edge Computing
• …
Bringing smart assistants…
• Not IoT performance testing
• Leveraging smart assistants for
performance testing
Just say it
• “Alexa, ask Perf Guru to start a smoke load test in
regression build”
• “Hey Google, ask Perf Guru for the latest load test
status”
• “Alexa, ask Perf Guru to increase the duration of my
current test to 15 minutes”
Use Cases
• Wake Up > Trigger Tests > Track results
• Detect anomalies and get notified
• Schedule tests
Pros
• Full control over voice
• Operational efficiency
• Time and Effort
• Enhance CI/CD
Why DevOps Tools Can’t Deliver Value
Joe Friedrichsen, Managing Director
October 2018
Email: [email protected]: linkedin.com/in/joefriedrichsen
Fall in love with the problem not the solution
• We originally thought our problem was inaccurate testing environments (Dev, SIT, UAT)– Open ended questions with target audience – Dev, Dev
Managers, Operations, SME
– We heard consistently that we had too many handoffs, too much manual work
– We heard our Software Development Life Cycle and tools was old and needed modernization
– Our existing automated regression suite wasn’t as automated as we thought
– Our release management process wasn’t flexible enough for what our business customers were demanding
A fool and his tool are soon departed
• DevOps is a software engineering culture and practice that aims at unifying software development and software operation
• Culture doesn’t change overnight, it’s a multi-year journey that begins with a first step
• Any journey needs a roadmap to keep focused yet allow for flexibility based off learnings
Culture change is demonstrated at the
top
From Puppet Labs State of DevOps 2017 Report
Define the “What” and change the
processes to tell “How” to get thereContinuous Delivery
Continuous
Integration
• Test-cases traceable to requirements.
• On-Demand and Incremental Testing.
• Seamless integration with existing reporting solutions.
• Comprehensive auditing and reporting capabilities to ensure IT governance and compliance.
• Deployment automation across all environment.
• New provisioning of environments to run multiple tests in parallel.
• Integration of deployment and release processes with Infrastructure Configuration and provisioning tools
• Development environment integrated to source code repository via code review server.
• Artifact repository tool consistently used and accessible from all environments.
• Builds traceable to source code and requirements.
• Project Planning and Requirement Management
• Requirement backlog grooming and prioritization
• Define and manage the requirements and present them in a structured and visual way that everyone in the software development lifecycle can understand.
Continuous
Deployment
Continuous
Testing
Continuous
Requirements
Processes changed
Release Management Code Design, Code review
Branching Strategy Test Automation Life Cycle
Project Delivery Life Cycle Software Development Life Cycle
Finally a tool slide• We used all Open Source
applications using HP QC as an anchor for requirements, test cases, test execution and defect management
• GitLab, Jenkins, SonarQube, Selenium, Artifactory, Hygieia, Junit, SOAPUI, Ant, JMeter
• Each Dev team has someone who is an expert on these tools
• For security we are using Jenkins to launch security scanning tool within our CI/CD pipeline (Think DevSecOps)
Upcoming Vivit Webinars
October 18, 2018SIG Talk: IT Operations - Optimize Hybrid Cloud Environments with OpsBridge and get 3rd Party Metric, Event, Topology, and Log Data into OpsBridge8:00 - 9:00 AM PDT (Los Angeles), 12:00 - 1:00 PM EDT (New York), 18:00 - 19:00 CEST (Frankfurt)https://www.vivit-worldwide.org/events/EventDetails.aspx?id=1146836&group=
November 6, 2018Founders Spotlight Series: Vivit Director and Leader, Bob Crews9:00 - 10:00 AM PST (Los Angeles), 12:00 - 1:00 PM EST (New York), 18:00 - 19:00 CET (Frankfurt)https://www.vivit-worldwide.org/events/EventDetails.aspx?id=1148963&group=
Vivit SIG Talk
• Complete the short survey
• For more information, go to:
#VivitSIGTalk
http://www.vivit-worldwide.org/?page=Quality_Testing
Thank You
