33
Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions DEV321

Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Embed Size (px)

Citation preview

Page 1: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Continuous Feedback in Agile Teams

Ed GlasPrincipal Test Manager, TFSMicrosoft Corporation

Sebastian HolstChief Marketing OfficerPreEmptive Solutions

DEV321

Page 2: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

The Value CycleDEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement

Page 3: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Delivering Continuous Value

OPERATIONAL EXCELLENCE

TIMELY INNOVATION

Page 4: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Continuous Value Delivery with Visual Studio 2012

• Architecture modeling and validation

• Best in class developer productivity• Test driven development• Unit testing frameworks• QoS testing tools• Load testing• Performance testing

• Build and test lab management• Built in continuous integration• Exploratory testing

• Production debugging: IntelliTrace

• Integrated incident management

(System Center -> TFS integration)

DEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement• Backlog and sprint management

• Visual task boards

• Storyboarding tools

• PreEmptive Analytics

• Feedback collection and integration

Page 5: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Impediments to Delivering ValueDEFINEValue definition and ideation

• BA misunderstands customer requirements

• Long cycle times• Changing requirements• Conflicting requirements

DELIVERIdea to working software

• Dev team misunderstands requirements

• Changes are resisted and expensive

• Feature focused, not customer experience focused

• Test environments are not production

OPERATEDeployment to Continuous Improvement

• Incident root cause notification to devs

• Tooling silos / send logs• No repros -> delays in MTTR

Page 6: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Storyboarding: Get the Definition Right DEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement• Storyboarding tools

Page 7: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

demo

PowerPoint Storyboarding

Page 8: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Storyboarding: Get the Definition Right DEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement• Enables rich

communication with stakeholders

• Leads to scenario focus• Lightweight way to

iterate designs

• Conveys the customer experience

• Clarifies customer expectations

Page 9: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Feedback: Straight from the Customer DEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement

• Feedback collection and integration

Page 10: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

demo

Stakeholder Feedback

Page 11: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Feedback: Straight From the Customer

• Use direct customer feedback to improve designs

DEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement

• Feedback tool ensures nothing is lost in translation

• Customers can give feedback using live bits

Page 12: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Leveraging Operations to Improve Your Software

• Use exception counts to focus on the right bugs

• Rich bug capture from intellitrace enables rapid resolution

• Production debugging: IntelliTrace

• Integrated incident management (System Center -> TFS integration)

• PreEmptive Analytics

DEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement• Operational data enables

you to better prioritize your backlog

Page 14: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

partner

Runtime Intelligence & PreEmptive Analytics for TFS

Page 15: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Have a Windows Phone?

Download our companion app: TechEd Yoga

Page 16: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

PreEmptive Analytics

Validate test plans against user patterns and preferences

Post-compile instrumentation beyond the data center and across app

layers

INSTRUMENTATION

Actionable application and user feedback

FEEDBACKSupport

priorities

Clarify requirements

Prevent and detect tampering

IP protection, privacy & opt-in policy enforcement, and tamper defense

HARDENING

Near real-time alerts

Page 17: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

InstrumentationInjection: .NET & JavaAPI: Native, JavaScript, Java …

Surface & PlatformServer, thick client, mobile, cloud, web (ASP.net, HTML5, …)

RepositorySaaS and On-Premises

Runtime IntelligenceCustom data, opt-in enforcement, offline caching, user behavior…

PreEmptive Analytics for TFSRule-driven intelligent work item creation connecting development and operations through near real-time alerts and encoding of business priorities.

PreEmptive Analytics

Page 18: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

demo

A sprint through Runtime Intelligence

Page 19: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions
Page 20: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions
Page 21: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions
Page 22: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions
Page 23: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions
Page 24: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Maximizing revenue within Yoga-pedia

Culture drives user experience and software quality

Try – Buy - Freemium

Know thy user: A/B/n testing

Page 25: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

demo

PreEmptive Analytics for TFS

Page 26: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

MEAN TIME TO REPAIR

CYCLE TIME

PRODUCT

BACKLOG

OPS BACKLOG

Sprint Monitor

Enabling Continuous Value DeliveryDEFINEValue definition and ideation

DELIVERIdea to working software

OPERATEDeployment to Continuous Improvement

• Architecture modeling and validation

• Best in class developer productivity• Test driven development• Unit testing frameworks• QoS testing tools• Load testing• Performance testing

• Build and test lab management• Team build• Built in continuous integration• Exploratory testing• Feedback collection and

integration

• Backlog and sprint management

• Visual task boards• Storyboarding tools

• Production debugging: IntelliTrace

• Integrated incident management

(System Center -> TFS integration)

• PreEmptive Analytics

Page 27: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Related Content

Breakout Sessions

FDN02 Application Lifecycle Management (ALM): It’s a Team Sport

DEV321 Continuous Feedback in Agile Teams

DEV344 Developer Collaboration with Visual Studio 2012

DEV346 All Aboard the Team Foundation Server Express

DEV212 Implementing Scrum Using Team Foundation Server 2012

DEV316 Application Lifecycle Management Tools for C++ in Visual Studio 2012

AAP309 Making Agile Estimation Work

DEV263 Dev-Ops Best Practices On The Microsoft Stack

DEV214 Introducing the New Visual Studio 2012 Unit Testing Experience

DEV337 Software Testing with Microsoft Test Manager 2012 and Lab Management

DEV370 Automating Server-Based Build, QA and Test with Visual Studio 2012

Page 28: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Related Content

Breakout Sessions

DEV362 From Development to Production: Optimizing For Continuous Delivery

DEV310 Continuous Delivery of Windows Azure Cloud Apps

DEV318 Working on an Agile Team with Visual Studio 2012

DEV390 IntelliTrace, What Is It and How Can I Use It To My Benefits

DEV217 Deep Dive Into Team Foundation Server 2012 Agile Management Tools

DEV345 The Accidental Team Foundation Server Admin

AAP401 Real World Developer Testing with Visual Studio 2012

DEV340 Taking ALM to the Cloud with the Team Foundation Service

DEV317 Going Beyond F11: Debug Better and Faster with Visual Studio 2012

DEV312 Create Robust, Maintainable Coded UI Tests with Visual Studio 2012

DEV411 Testing Un-Testable Code with Fake in Visual Studio 2012

Page 29: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Related Content

Breakout Sessions

DEV324 A Modern Architecture Review: Using the New Code Review Tools

DEV412 Identify & Fix Performance Problems with Visual Studio 2012 Ultimate

Hands-on Labs (session codes and titles)

DEV11-HOL

Agile Project Management in Team Foundation Server 2012

DEV12-HOL

Build the Right Software and Collaborate Effectively Using Storyboarding and Feedback Tools in Visual Studio 2012

DEV13-HOL

Using IntelliTrace with Production Systems to Quickly Diagnose and Fix Issues

DEV16-HOL

Learn How Microsoft Test Manager 2012 Will Embrace an Exploratory Testing Approach

DEV17-HOL

Explore the New Unit Testing and Code Clone Capabilities of Visual Studio 2012

DEV19-HOL

Discover How the New Features of Team Foundation Server 2012 Can Improve Collaboration in Your Development Team

Page 30: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

DEV Track Resources

Visual Studio Home Page :: http://www.microsoft.com/visualstudio/en-us

Jason Zander’s Blog :: http://blogs.msdn.com/b/jasonz/

Facebook :: http://www.facebook.com/visualstudio

Twitter :: http://twitter.com/#!/visualstudio

Somasegar’s Blog :: http://blogs.msdn.com/b/somasegar/

Brian Harry’s Blog :: http://blogs.msdn.com/b/bharry/

Page 31: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Resources

Connect. Share. Discuss.

http://europe.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

Page 32: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

Evaluations

http://europe.msteched.com/sessions

Submit your evals online

Page 33: Continuous Feedback in Agile Teams Ed Glas Principal Test Manager, TFS Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.