Embed Size (px)
DESCRIPTION
There are as many views and definitions of Data Mining as there are people working in and on the topic. Confusion reigns and people ask; what is it; why do we need it; and isn’t it just Data Mining rebranded? In this slide deck and presentation we set the scene an highlight the differences and need for Data Mining in order to give a framework for case studies and future projects. So - why do we need it? The economic, industrial, commercial, social, political and sustainability problems we face cannot be successfully addressed using the management techniques and models largely inherited from the Industrial Revolution. The world no longer appears infinite in resources, slow paced, linear and stable. We now see the limitations; feel the impact of rapid change; and we can conceptualize the non-linear and unstable nature of it all! We are also starting to comprehend the scale and the need for machine assistance. Modeling our situation ! Sophisticated computer models for weather systems are now complemented by ecological, economic, conflict and resource modeling of varying depth and accuracy. However, the key is always the accuracy and coverage of the primary data. We started with modest databases and data mining, but they mostly proved inadequate, and we are now amassing vast databases on every aspect of life - people, planet and machines. This ‘BIG DATA’ explosion demands a rethink of how, what, and where we gather data; the way we analyze and model; and the way we make decisions. So - what is the big difference? Data Mining was limited, planer, simple, linear and constrained to a few relationships amongst people: what they did, where they went, who they knew and so on. In contrast; Big Data is unbounded, spans all peoples and machines in all domains and activities with application to every aspect of life, business, industry, government and sustainability etc. It also takes into account the non-linear nature of relationships and events. “Big Data is an almost unconscious outcome of the desire and need to sustain all peoples on a rapidly smaller looking planet”
Citation preview
Big - Data - MiningPeter Cochrane
ca-g loba l .orgcochrane.org.uk
COCHRANE a s s o c i a t e s
The differences, gains and application areas
Thursday, 31 January 13
Data Mining Big Data
Lots of detail Lots of relationships
The bigpicture
A closeup view
Thursday, 31 January 13
What the information is comprised of, and all the related data...or vice versa !
What about the data in the Information ?
D a t a M i n i n g
Thursday, 31 January 13
How
people are related
in a limited num
ber of
slow m
oving fields
D a t a Mining
Thursday, 31 January 13
Where are the commonalities, relationships, and causalities hidden in the bigger picture ?
But what about the
Why ? B i g D a t a
Thursday, 31 January 13
Why ?
What ?
..are these people meeting
...do they buy the same xxx
...wear the same yyy
...eat the same zzz++++
...binds them together
...are they doing/planning
...do they have in common+++
Who ? ..do they work for..do they know..employ+++
B i g D a t a
Thursday, 31 January 13
Superficially they may look the same, but they are not !What are the differences and why is this important ?
High Net WorthInvestor
Head TeacherSolvent
Fraudster
1078653271
Thursday, 31 January 13
Superficially they may look the same, but they are not !What are the differences and why is this important ?
High Net WorthInvestor
Head TeacherSolvent
Fraudster
1078653271
SAMEFamilyFundingEducation
FriendsSocietyOpportunity
FoodMusicClothing
DoBTownHome
Thursday, 31 January 13
Superficially they may look the same, but they are not !What are the differences and why is this important ?
High Net WorthInvestor
Head TeacherSolvent
Fraudster
1078653271
DIFFERENTMoralsDesiresAmbitions
WealthBankingPurchases
FearsHopesRelationships
SAMEFamilyFundingEducation
FriendsSocietyOpportunity
FoodMusicClothing
DoBTownHome
Thursday, 31 January 13
Superficially they may look the same, but they are not !What are the differences and why is this important ?
High Net WorthInvestor
Head TeacherSolvent
Fraudster
1078653271
DIFFERENTMoralsDesiresAmbitions
WealthBankingPurchases
FearsHopesRelationships
SAMEFamilyFundingEducation
FriendsSocietyOpportunity
FoodMusicClothing
DoBTownHome
Why ? What happens next and where is this going ?
Thursday, 31 January 13
Defining what links, associations, relate all these people and their f r i e nd s a nd f am i l i e s turns out to be complex
and dynamic in hy p e r s p a c e . . . wa y beyond any human capacity to fathom
B i g D a t a
Thursday, 31 January 13
It is about joining the d o t s , p l o t t i n g t h e relationships, seeing the sensitivities, understanding cause and effect
B i g D a t a
Thursday, 31 January 13
...is all about the s o c i o l o g y o f people, things, and machines !
B ig Data
Thursday, 31 January 13
B ig DataEssentially
evolvinggloball o n gtermlive
Thursday, 31 January 13
Why
is
this all So
very
Vital ?
Green
Important
Thursday, 31 January 13
Security
Law&
OrderG r e e nS u s t a i n a b i l i t y
Green
$$$Commerce
Itis
about the
sustainability
Health
CareTravel
Logistics
Defe
nce
InsuranceMan u f a c t u r e
SupplyProduction
of societies dealing with finite resources, growth and change
Retail
Manag
ement
sensors
Thursday, 31 January 13
Your mobile device knows more and more about you day by day !
Where you are ?Where you have been ?Where you are likely to be going to ?Who you have met ?Who you are going to meet ?Who you call ?Who calls you ?Who you TXT - IM - Link ?All your contactsAll your urlsAll you passwordsWhat you are doing now ?What have you done in the past ?What games you play ?What apps you use ?What music you listen to...?What you watch...?What you read...?++++++++++
Thursday, 31 January 13
A x i o m : O u r f u t u r e products, processes and services will demand greater embedded intelligence and communication in order to affect material and energy efficiencies...
Thursday, 31 January 13
• cars• food• tools• offices• homes• clothing• appliances• consumables
Smart:
Thursday, 31 January 13
But Why ??Thursday, 31 January 13
But Why ??All our old management methods,
modeling and understanding has run out of steam !
Thursday, 31 January 13
Theonly game
in town thatmight work for us
Computer modeling, iterationand war gaming in a n-dimensional
space at speed where the data input and base assumptions are no longer constants, or
indeed, linear as we have happily assumed in the past!
Thursday, 31 January 13
Andthatneeds
Data
lots and
lots of
DataThursday, 31 January 13
Some of the biggest challenges ahead are social andanalytical...and we
are largely flying blind How do we,
and every society benefit
whilst we transit to
sustainable models and new ways of
living ? ....and we appear to . have no choice !
Thursday, 31 January 13
B ig DataAppears to be our only choice if we are to progress and
prosper
Thursday, 31 January 13
Thank You
ca-global.orgcochrane.org.uk
COCHRANE a s s o c i a t e s
Thursday, 31 January 13
