30
Johann Günther 1 Big Data and Open Data Introduction and Definition Open Data and Big Data The Impact on Digital Society and Smart Cities" NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife March 5 - 8, 2015 Prof. Dr. Johann Günther Visiting Professor at: Danube University Krems, Austria, Source: Gottfried Salzmann Professor State University of Telecommunications, Russia, Stadtlandschaft New York Research Professorship Jianghan University, Wuhan, China [email protected]

Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 1

Big Data and Open DataIntroduction and Definition

Open Data and Big Data

The Impact on Digital Society and Smart Cities"

NETTIES 2015

13th International Conference on Networking Entities

La Casona, Tacoronte, Tenerife

March 5 - 8, 2015

Prof. Dr. Johann GüntherVisiting Professor at: Danube University Krems, Austria,

Source: Gottfried Salzmann Professor State University of Telecommunications, Russia,

Stadtlandschaft New York Research Professorship Jianghan University, Wuhan, China

[email protected]

Page 2: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 2

2012: 16 years old girl in Netherlandsposted birthday party invitationmistakenly public on Facebook3000 people came

Picture: VMworld Gatherings, Parties and Activities

Page 3: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 3

Data Worldwide

• Beginning recorded history till 2003: 5 billion Gigabytes

• 2011: 5 billion Gigabytes every 2 days• 2013: 5 billion Gigabytes every 10 minutes• 2015: 5 billion Gigabytes every 10 seconds

Source: Smolan & Erwitt 2012)

Page 4: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 4

Big Data Worldwide

2012: 9,8 billion $2017: 32,4 billion $

Source: IDC

Page 5: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 5

Big Data = large collections of data

Data Sets = old term from Main Frame Computing

Today Data Sets can not be handled with traditional applications

Page 6: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 6

Development

Main Frame Computing

Personal Computing

Cloud Computing

Central Decentral

Page 7: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 7

Very Important !!!

BIG DATA = GLOBAL

Page 8: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 8

IAFeS

Our Organisation IAFeS uses eScience,which is based on Big Data

E-Science = computationally intensive science- highly distributed network environments- uses immense data sets

Page 9: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 9

Characteristics of Big data

* Volume – Quantity of data * Variety* Velocity – due to the volume of data;

high speed of precessing is needed* Veracity - Quality of the data = problem.* Complexity - Data management with

- large volumes of data - from multiple sources

Page 10: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 10

Obama and Big Data

• 2012 Obama administration announced Big Data Research and Development Initiative

• Big data analysis = important for Obama's re-election 2012• US Federal Government owns six of the ten

most powerful supercomputers in the world• „Utah Data Center“ under construction

by „United States National Security Agency“Handle large amount of information collected by the NSA

Picture: http://blogs.reuters.com/great-debate/2013/07/25/obamas-plan-one-nation-under-government/

Page 11: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 11

Internet in Things will create more data

Page 12: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 12

2020: 25 Billion Devices online

Source: Gartner

Page 13: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 14

Since 2008: 200 billion Apps downloaded50% in 2013 (100 billion)

2014: 2 billion smartphones

2020: 8 out of 10 will have smartphone

Source: Gartner, IDC

Page 14: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 15

Smart Phone Market:

* Samsung* Apple* Lenovo with Motorola* Huawei* LG Electronics* Xiaomi (Chinese “Apple”

Source: Gartner, IDC

Page 15: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 17

Big Data in a dual, interconnected manner:

• Targeting of consumers • Data-capture

Page 16: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 18

Big Data = modern form of communication= Social Media= leads to a hyper-networked society= individual acts spread via the network

Source: Andre Zwitter, „Network Ethics and Big Data: Cahnging Power in a Networked Society“, in BIFFL, Gudrun & RÖSSL, Lydia: „Migration & Integration 5“, 2014

Page 17: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 19

Closing the profil on Facebook= „Virtual Identity Suicide“

Page 18: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 20

Facebook: 1,228 billion user (end 02/2014)282 million in Europe27,38 million in Germany3,24 million in Austria

Instagram: 200 million user

Twitter; 232 million active user

Google+ 300 million

Xing: 12,65 million

Page 19: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 21

Social Networks:

* Facebook* Instagram* Twitter* Google* Xing* Flickr* Foursquare* Last.fm* Delicious* Scribd* Slideshare* Covestor* Pinterest* tumblr* Goodreads* WhatsApp

Page 20: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 22

Open Data

Data free available

Use for everyone

Republishing

No copyright

Page 21: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 23

Open Data versus Closed DataSource: Donau-University, Peter Parycek

Page 22: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 24

Open Data versus Closed DataSource: Donau-University, Peter Parycek

Page 23: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 25

Our world is observable and configurable infrastructure:- Social Web- Smart Phone- Smart Home- Smart City

The objective is efficiency. e.g .: traffic control and traffic lights

Page 24: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 26

Users of Big Data

eBay.com:

- 2 data warehouses at 7.5 petabytes and 40PB - + 40PB Hadoop cluster for search,

consumer recommendations and merchandising

- Inside eBay’s 90PB data warehouse

Page 25: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 27

Users of Big Data

Amazon.com:- handles millions of back-end operations every day- more than half a million third-party sellers- Linux-based –

in 2005 the world’s three largest Linux databases- 7.8 TB, 18.5 TB, and 24.7 TB

Page 26: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 28

Users of Big Data

Facebook* handles 50 billion photos* 1,4 billion users (end 2014)

Page 27: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 29

Users of Big Data

• More Applications and Examples = this conference

Page 28: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 30

„Google will knowthe answer to your question

before you ask it“

Page 29: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 31

„Computer will understand us better than

we understand ourselfes.“

(Roy Kurzweil, 2014)

Page 30: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities

Johann Günther 32

• The future is open, but the past is past.

• Technology is neutral - they can both good and bad

• Back to "Digital Biedermeier“?