Big data, small strategy

Preview:

DESCRIPTION

89% of all marketers use no data, whatsoever in their decision making process. That is extraordinary. This talk was about how to use lean principles to get started with Big Data in the enterprise

Citation preview

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

flux[x]

BIG DATA, SMALL STRATEGY

Strategy by experimentation

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

hello

/ Mark Bjornsgaard/ Director Fluxx Adventures/ Technology incubator/ Invests in our own ideas

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

The next 30 mins…

/ Part 1 – A brilliant theory (10mins) What we mean by Big Data? How does it really work? In the real world

/ Part 2 – The real story (10mins) The 7 things they don’t tell you about using big data

/ Part 3 – Strategy by experimentation (10mins)

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

WHAT WE MEAN BY BIG DATA?

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Big data

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

What is the data in big data?

Big Data Sets

Sales data (epos and

online)

Web analytics

Advertising analytics

CRM databases

Machine data –

website logs

Unstructured social data

Documents and email

Sensor data

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

How does data become big?

Volume

VarietyVelocity

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

A definition…

“Data that’s an order of magnitude bigger than were accustomed to”

“Data that exceeds the processing capacity of conventional database systems. The data is too big, moves too fast, or doesn’t fit the structures of our database architectures”

“A set of technology advances that have made capturing and analysing data at high scale and speed vastly more efficient”

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Like its 1996 all over again…

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

HOW DOES IT REALLY WORK?

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

How does it work?

R HadoopData scientists

Big data is…..“ A set of technology advances that have made capturing and analysing data at high scale and speed vastly more efficient”

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

How does it work?

Your data

“big data”

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

How does it work?

Your data

“big data”

Category 1 Category 2 Category 3 Category 40

1

2

3

4

5

6

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

IN THE REAL WORLD

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then – have a sale Now – target individuals

In…Retail

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then - pipelineNow – triangulate multiple data sets to identify targets

In…online marketing

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then – data locked in unusable formats

Now – rich, real time analytics

In…IT

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then – paper validationNow – telematics and unstructured data

In…risk and fraud management

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then – gut instinctNow – crime hotspot identification

In…law enforcement

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then – keyword searchesNow – semantic and NLP “understanding”

In…medical research

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Then – subjective “truth” Now – objective insight

In…sports

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

PART 2 – IN THE REAL WORLD

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

90% of colleagues don’t really care (and probably never will)

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

A Vanguard doesn’t really exist!

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Use cases are still limited

Big Data

Digital marketing

Data exploration

and discovery

Fraud detection

and prevention

Social network and relationship

analysis

Machine-generated

data analytics

Data retention,

data archiving

xx

x

x

x

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Hires are scarce…

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

R and Hadoop aren’t for everyone…

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Big data only shows us what’s not obvious…

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Using big data actually means….

/ Colleagues who are biologically pre-programmed not to care

/ No best practice to rely on/ Very specific use cases within business/ Hiring aching expensive people/ To use a software anyone with an IQ of less than 150

shouldn’t go near/ All in the cause of…..looking for non conclusive,

obscure patterns, which may or may not lead to any business value

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

PART 3 – STRATEGY BY EXPERIMENTATION

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Strategy by experimentation

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

1. Set aside some time (and budget)

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

2. Find a partner you trust

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

3. Get everyone involved

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

4. Identify a business issue you have…

Why is the ROI on my CPC account

declining?

What kind of people make the

largest purchases?

How can I drive sales of

recommendations in the check out

process?

There’s always a sales spike on

Thursday evenings – why?

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

5. Identify data sets which might hold clues

Adwords data

Web analytics data

Brand tracking

Transactional data

Store footfall

Social data

There’s always a sales spike on

Thursday evenings – why?

Logistics files

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

6. Play detective

Patterns CorrelationsRelationships

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

7. Rinse and repeat

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

8. Re-humanise the story…

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

9. Shout about it

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

10. Enjoy the journey

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

To summarise

/ Define big data for yourself – see how it could apply to you

/ Accept the challenges/ Start small, grow and publicise success

flux[x]

[x] fluxx.uk.com/consults © 2011 – All rights reserved Fluxx Ltd.

Thank you!

Recommended