Embed Size (px)
Citation preview
16/09/2015
1
What’s the Big Deal
with
Big Data?
Kevin Swingler
16/09/2015
2
1.44 MB
700 MB
Over 90% of all data created by mankind was
generated in the last two years.
16/09/2015
3
Around 1000 Servers per container
Estimated 2,000,000 servers at Microsoft
16/09/2015
4
Data Sizes
Value Abr. Name Download Time @45Mbps
1000 bytes kB Kilobyte < 1 second
10002 = 1000kB MB Megabyte < 1 second
10003 = 1000MB GB Gigabyte 4 mins
10004 = 1000GB TB Terabyte 74 hours
10005 = 1000TB PB Petabyte 8.5 Years
10006 = 1000PB EB Exabyte 8000 Years
It would be quicker to put a Petabyte rack in a backpack and walk with it than to
download it!
Data Size Examples
Size Example File Storage
100 Kilobytes A small document
1 Megabyte Typical English book 500 pages
470 Megabytes NASDAQ Open, Close Since 1970
800 Megabytes The human genome
1 Gigabyte 7 minutes HDTV £5 Memory stick
11 Gigabytes 35 million Amazon reviews £20 Memory stick
300 Gigabytes Million song dataset (not the music)
1 Terabyte 20,000 Filing cabinets of text £50 disk drive
8 Terabytes Twitter data generated per day
1 Petabyte 13.3 years of HDTV £300,000 Rack
2.5 Petabytes Walmart customer database
30 Petabytes Facebook database
16/09/2015
5
Measure Everything
Store Everything
Analyse Everything
16/09/2015
6
80 hours of video
2.5 million posts
300,000 tweets
200 million messages
Internet of Things
Sport
30MB per lap
People
1 Minute of Social Media
The Internet of Things
16/09/2015
7
The Smart Grid
16/09/2015
8
16/09/2015
9
http://www.spectator.co.uk/features/9093961/little-brothers-are-watching-you/
http://www.telegraph.co.uk/technology/news/8480702/Tom-Tom-sold-drivers-GPS-details-to-be-used-by-police-for-speed-traps.html
16/09/2015
10
http://www.cnet.com/uk/news/samsung-changes-smarttv-privacy-policy-in-wake-of-spying-fears/
http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/
16/09/2015
11
16/09/2015
12
16/09/2015
13
MSc. in Big DataBig data skills are in high demand and they
attract high salaries. The MSc. in big data at
the University of Stirling is a taught
advanced Masters degree covering the
technology of big data and the science of
data analytics. The course is taught in the
beautiful Stirling campus in the heart of
Scotland with support from companies
who recruit data scientists.
www.cs.stir.ac.uk/entrants/bd/
Next …
• Lunch! Explore the campus, eat some food,
whatever…
• 1.20pm be back in Lab 2A15 / 2A17
