Data Collection and Analysis for Better Requirements

Preview:

DESCRIPTION

According to studies, 64 percent of features in systems are rarely—or never—used. How does this happen? Today, the work of eliciting the customers' true needs, which often remains elusive, can be enhanced using data-driven requirements techniques. Brandon Carlson describes why traditional requirements analysis is so difficult and presents a set of seven data collection approaches and analysis techniques you can employ on your projects right away. Learn how to instrument existing applications and develop new requirements based on operational profiles of the current system. Learn to use A/B testing—a technique for trying out and analyzing alternative implementations—on your current system to determine which new features will deliver the most business value. With these tools at hand, you can help users and business stakeholders decide the best approaches and new features to meet their real needs. Now is the time to take the guesswork out of requirements and get the facts.

Citation preview

BW6 Concurrent�Session�11/13/2013�2:15�PM�

������

"Data Collection and Analysis for Better Requirements"

���

Presented by:

Brandon Carlson Lean TECHniques, Inc.

��������

Brought�to�you�by:��

��

340�Corporate�Way,�Suite�300,�Orange�Park,�FL�32073�888Ͳ268Ͳ8770�ͼ�904Ͳ278Ͳ0524�ͼ�sqeinfo@sqe.com�ͼ�www.sqe.com

Brandon Carlson Lean TECHniques, Inc.

A self-proclaimed nerd, Brandon Carlson works for Lean TECHniques, Inc., an IT consultancy that helps teams deliver high-value, high-quality products to market. Since starting his career in 1995, Brandon has held positions from development and architecture to management—and he’s still learning. Passionate about elevating the performance of IT as a whole, he has helped numerous organizations from startups to Fortune 100 companies improve their product development and delivery systems. Brandon’s current interests include data-driven product definition/development and professionalism in the world of software development. He can be reached on Twitter and pretty much everywhere else on the web as “bcarlso.” Read his blog at bcarlso.net/.

Just The Facts Ma’amData Collection and Analysis for Better

Products

About Me

Brandon Carlson

Lean TECHniques, Inc.

bcarlso@leantechniques.co

On the web: ‘bcarlso’

Required Reading

Theory of Constraints

1525 20 2510

Theory of Constraints

1525 20 2510

Theory of Constraints

1525 20 2510

Agile: IT as Constraint

MarketingSales Operations CustomerIT

Lean: Optimize the Whole

MarketingSales Operations CustomerIT

A Turning Point

“Our highest priority is to satisfy the customerthrough early and continuous delivery

of valuable software.”

“Our highest priority is to satisfy the customerthrough early and continuous delivery

of valuable software.”

Information as Constraint

MarketingSales Operations CustomerIT

MarketingSales Operations CustomerITInformation

MarketingSales Operations CustomerIT

Missing Feedback Loops?

What we (don’t) know...

http://ww

w.flickr.com

/photos/flamephoenix1991/8376271918/sizes/m

/

Law Of Small Numbers

http://ww

w.flickr.com

/photos/wfryer/8166990403/

Confirmation Bias

http://ww

w.geograph.org.uk/photo/35330

WYSIATI

http://ww

w.flickr.com

/photos/3059349393/8000156483/

Availability Bias

http://no.wikipedia.org/w

iki/Fil:Rottw

eiler_standing_facing_left.jpghttp://com

mons.w

ikimedia.org/w

iki/File:Germ

an_Shepherd_Dog_w

ith_disc.jpg

Response Bias

http://farm4.staticflickr.com

/3444/3392536961_8b9aae5f6b_o.jpg

Preference Theory

http://ww

w.flickr.com

/photos/sis/200768094/sizes/m/in/photostream

/

Social Norms

http://comm

ons.wikim

edia.org/wiki/File:Facebook_like_thum

b.png

7 SpotlightsSeven factabulous ways to get better

requirements

http://ww

w.flickr.com

/photos/enricomaritano/4210706861

Traffic Analysis�

http://ww

w.flickr.com

/photos/14954127@N00/4546555910

Observe First

�Stalking > Talking

Leverage Development

log(sha1(currentUser, deviceId));

Leverage Development

results = performSearch(searchString)

if results.empty?

log(“empty.search”, searchString)

end

Enterprise Anthropology�

http://ww

w.flickr.com

/photos/ricardoalvarez/162914130/

A/B TestChoose between

two options

http://ww

w.flickr.com

/photos/donkeyhotey/5731191759

Restrict Access�

http://ww

w.flickr.com

/photos/harvypascua/46114061

Play the Nickel Slotsaka Little Bets

http://ww

w.flickr.com

/photos/orphanjones/2370564178

7 Spotlights

• Traffic Analysis

• Observe First

• Leverage Development

• Enterprise Anthropology

• A/B Test

• Restrict Access

• Nickel Slots

7 Spotlights• Traffic Analysis

• Observe First

• Leverage Development

• Enterprise Anthropology

• A/B Test

• Restrict Access

• Nickel Slots

Use the 7 Spotlights to get the facts about what

your customers do...

...then combine that with what they say

...to help you eliminate waste and discover the

right product.

The “Right” Product

• Reduced Market Risk

• Increased Customer Understanding

• “Good enough” Features

• Higher ROI

• Tactical Agility

The “Right” Product

• Reduced Market Risk

• Increased Customer Understanding

• “Good Enough” Features

• Higher ROI

• Tactical Agility

i-want-the-facts@leantechniques.co

Questions?bcarlso@leantechniques.co

@bcarlso

Recommended