16
BW6 Concurrent Session 11/7/2012 2:15 PM "Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am" Presented by: Brandon Carlson Lean TECHniques, Inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 8882688770 9042780524 [email protected] www.sqe.com

Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

Embed Size (px)

DESCRIPTION

According to the Standish group, 64 percent of features in systems are rarely-or never-used. How does this happen? Today, the work of eliciting the customers' true needs, which remains elusive, can be enhanced using data-driven requirements techniques. Brandon Carlson introduces data collection approaches and analysis techniques you can employ on your projects right away. Find out how to instrument existing applications and develop new requirements based on operational profiles of the current system. Learn to use A/B testing-a technique for trying out and analyzing alternative implementations-on your current system to determine which new features will deliver the most business value. With these tools at hand, you can help users and business stakeholders decide the best approaches and best new features to meet their real needs. Now is the time to take the guesswork out of requirements and get "Just the facts, Ma'am."

Citation preview

Page 1: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

 

    

BW6 Concurrent Session 11/7/2012 2:15 PM 

       

"Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am"

   

Presented by:

Brandon Carlson Lean TECHniques, Inc.

         

Brought to you by:  

  

340 Corporate Way, Suite 300, Orange Park, FL 32073 888‐268‐8770 ∙ 904‐278‐0524 ∙ [email protected] ∙ www.sqe.com

Page 2: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

Brandon Carlson Lean TECHniques, Inc.

A self-proclaimed nerd, Brandon Carlson works for Lean TECHniques, Inc., an IT consultancy that helps teams deliver high-value, high-quality products to market. Since starting his career in 1995, Brandon has held positions ranging from developer to manager—and is still learning. Passionate about elevating the performance of IT as a whole, he has helped numerous organizations from startups to Fortune 100 companies improve their product development and delivery systems. Brandon’s current interests include data-driven product definition/development and professionalism in the world of software development. He can be reached on Twitter and pretty much everywhere else on the web as “bcarlso”. Read his blog.

Page 3: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

1

Just The Facts Ma’amData Collection and Analysis for Better

ProductsProducts

About Me

Brandon Carlson

Lean TECHniques, Inc.

[email protected]

On the web: ‘bcarlso’

Page 4: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

2

Hidden Constraints

A Turning Point

Page 5: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

3

Houston: WeHouston: We Have A Quality

ProblemProblem

Scope of the Problem

• As of 2010, the average IT shop spent about 27% of their software budget on custom software development.

• About 1 in 8 shops spent more than 50% of their software budget on custom software development.

Page 6: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

4

Friends, Romans, Countrymen, Lend me a Buck

Friends, Romans, Countrymen, Lend me a Buck

Page 7: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

5

Stop Listening To Your Customers!

7 Spotlights7 Spotlights

Seven factabulous ways to get better y g

requirements

Page 8: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

6

Play thePlay the Nickel Slotsaka Little Bets

1

Observe FirstStalking > Talking

2

Page 9: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

7

Web Analytics3

App Instrumentation

log(sha1(currentUser, deviceId));

4

Page 10: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

8

App Instrumentation

results = performSearch(searchString);

log( “Search:”

+ searchString

“R t d ”+ “Returned:”

+ results.size() );4

Split TestChoose between

two optionsp

5

Page 11: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

9

Toggle Features6

Enterprise Anthropology7

Page 12: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

10

7 Spotlights• Nickel Slots

• Observe First

• Web Analytics

• Application Instrumentation

• Split Testing• Split Testing

• Toggle Features

• Enterprise Anthropology

7 Spotlights

• Nickel Slots

• Observe First

• Web Analytics

• Application Instrumentation

• Split TestingSplit Testing

• Toggle Features

• Enterprise Anthropology

Page 13: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

11

Use the 7 Spotlights to get the facts about what

your customers do...y

...then combine that with what they say

Page 14: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

12

...to help you eliminate waste and discover the

right product.g p

The “Right” Product

• Reduced Market Risk

• Increased Customer Understanding

• “Good Enough” Features

Hi h ROI• High ROI

• Treasured

Page 15: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

13

The “Right” Product

• Reduced Market Risk

• Increased Customer Understanding

• “Good Enough” Features

Hi h ROI• High ROI

• Treasured

[email protected]

Page 16: Data Collection and Analysis for Better Requirements: Just the Facts, Ma'am

14

[email protected]

@bcarlso