Open Data

(c) 2011 Harri Luuppala, Heikki Kamppuri

All trademarks, images, and other referenced materials are the property of their respective owners

The Vision of Revolution 2020

24.5.2011

From Closed Systems to Open Data and Information

Harri Luuppala, Owner

Open Invest Oy

V 1.2



My relevant background

● Born 1958, Vammala, Finland● Last 20y Tieto Corp.

● Telecom, Banking, Insurance, Media, Manufacturing● Biz in Nordics, Baltics, UK, US, China, Portugal,...● Founder of Mobile Phone SW RD Biz incl.

Outsourcing biz (Nokia, Nokia Siemens Networks)

● Before Tieto● Instrumentarium● Valmet / Metso



From Closed Systems to Open Data and Information

Playground Open Data &Information

Vision 2020

Demand

A BriefHistory

Supply

Some Stories

All technologyis available.

But are we ready?



Part 1Playground



You need to understand my reasonings – so be patient!

● Markets with Asymmetric Information● Information Theory● From Open Source to Open Data● Disruptive Ideas and Ability to Vision● We need a solution for Asymmetric Information!● WEB 2.0 is coming – are you ready?



Markets with Asymmetric Information

● Akerlof, Spence, Stigliz, Nobel Prize 2001

● Realistic assumtion of Asymmetric Information (AI): Agents on one side of the market have much better information than those on the other side.● Akerlof: ”lemons paper” = study of used car markets

Sociology, Social antropology … → Economic Theory of AI

● Spence: – Market Signaling i.e education is signaling of productivity on labor markets

– New theory of Industrial Organisation

● Stiglitz:– Insurance company as the uninformed party gets information through

screening of customers i.e. risk classes



Information TheoryChannel theory

Maximum mutual information/Channel capacity:

Coding theory, two aspects namely:

Data compression (or, source coding)Error correction (or, channel coding)



Distruptive Ideas1. The World first major competition won by a voluntary SMS campain started by Finnish youths!

Won for Finns enabled by the SMS campaign

May 9, 2005, as a commentary outlet and alternative to news websites like the Drudge Report.[3] On February 7, 2011, AOL acquired The Huffington Post for US$315 million making Arianna Huffington editor-in-chief of The Huffington Post Media Group

2. Huffington Post guessed in Jan 2011 and NOW WE KNOW, there is a TREND!

The Revolution enabled byFacebook

3. Vision 2020Solution for Asymmetric Infor-mation by Open Data

http://en.wikipedia.org/wiki/Drudge_Report

http://en.wikipedia.org/wiki/The_Huffington_Post#cite_note-2

http://en.wikipedia.org/wiki/AOL



We need a solution for Asymmetric Information!

Huffington Post May 22, 2011



Web 2.0 is coming – are you ready?

Tommi Mikkonen, Antero Taivalsaari



Finnish Road to Open IT A Brief History

● Finnish Goverment decided 1989 to use only Open Systems. Project (1987-1989) was called T-90 or Toimisto-90 ● At that time Denmark and Sweden did similar decisions. The standard was

a guide for buyers:

– Buy Unix and later on Posix compatible (i.e. OS/2) for Servers...

– Relational Databases (Oracle got a strong position in Finland)

– Open Standards for documents/data● ISO 8859/1 character set preferred

● Government and Industry moved to Unix based servers 1986-2006. ● Peak was 1993-2000 – the depression 1993 and Euro+Y2K before 2000

pushed organisations to Unix (and OS/2) based Open Systems

● Today trend is to Linux based systems



Part 2Open Data and Information



From Open Source to Open Data

● Open Source ● SW: Kermit → LibreOffice

● Open Systems ● OS: Unix → Linux (Unix = many unixes)

● Open Standards ● DeJure (OSI, IEEE, Oasis,...)

– ISO i.e. OSI, IEEE i.e. Posix, Oasis i.e. ODF

● DeFacto (Linux, ...)

– Finnish Linus Torvalds had no money to buy IEEE Posix std → he used instead Open Solaris (Sun) as the base for Linux

● Open Interfaces (API, M2M, A2A, HCI,..)● Data Catalog, Interface(s), Metadata, Version and Lifecycle mgmt

● Open Data (vs Closed Data)● Public or Private



Open Data

● Open science data● No common agreed definition

● The International Council of Scientific Unions (now the International Council for Science) established several World Data Centers to

– minimize the risk of data loss and

– to maximize data accessibility,

– further recommending in 1955 that data be made available in machine-readable form

● Creators of data often do not consider the need to state the conditions of ownership, licensing and re-use. ● However the lack of a license makes it difficult to determine the status of a data

set and may restrict the use of data offered in an Open spirit.

● Because of this uncertainty it is also possible for public or private organizations such as IEEE to aggregate said data, protect it with copyright and then resell it.

--> OPEN ≠ FREE



History of Public Open Data- a Finnish point of view

FI 1989 Open Systems (Unix, RDBMS,...)FI 1994 Collect data once only (STP)FI 2008 Somus (Social media R&D)FI 2009 eAMSUS 2009 Open GovernmentUK 2009 Digital BritainFI 2009 Public eServices & eAdministrationFI 2009 Apps for Democracy Finland FI 2010 Public Open Data GuideFI 2011 The State owned Broadcasting

Company YLE decided to Open Data



EU PSI Directive (2003)



Open Data in Finland:data.suomi.fi

Public Open Data, Finland

Data Catalog = All public open data is listed here

http://www.facebook.com/group.php?gid=102381085627

Public Open Data – the guide published in Feb 2010



Gov Open DataUnfortunately Gov pages only in Finnish (May 2011)



Apps for Democracy FinlandWinner 2009

Brances and Leafs:Budget and Spending

Roots:Income



Apps for Democracy Finland Prize



Finnish Government has a well defined architecture to serve

● FI State Treasury: http://www.netra.fi

All data could beavaillable from thesame service-point

http://www.netra.fi/



Government Archive Standard: Sähke2

Will lead from imitation of static paper document to a dynamic decision support system



Open Data - SUPRISECase 1 - Climategate

Climate scientists and organisations pledged to restore public confidence in the research process by improving data management and opening up access to data



Open Data - RESPONSIBILITYCase 2 – Finnish Hunters + FB

Register of Hunting CardsRegister of Hunting Cards

+ = ?Official testOfficial test

ApprovalApproval

Hunting card – license to kill.Possible owner of a legal gun.

Hunting card – license to kill.Possible owner of a legal gun.

License to stealLicense to steal

This issue (hunting card + fb) is raised by Ilkka Lehtinen / COSS



Open Data – EARLY BIRDCase 3 – Proposal Phase

Proposal from Ministry ofTransportation andCommunication 2011

Availability and reusability of Public data

Right to use and mainly free of charge

Common Metadata and Data Catalog

Networking and reward to open public data



KAMU



Vaalilupausarkisto(Promised by politicians)



Journey Planner



TilannehuoneSituation Room



Boost innovationsFrom single sheet to complex ideas



Boost innovationsFrom single sheet to complex ideas



Identified challanges for Government of Finland

● External● Demand from EU, cizisens and other learers of information society (UK,

Sweden, US...) to Open Data

● Licenses/agreements to reuse data as Open Data

● Internal● Pricing models – high prices → low usage → few users → few innovations /

benefits for society

● Uncompatible systems → unnecessary costs → higher prices and poor information i.e. Healtcare

● Missing definitions / agreements for ownership and copyrights of government data

● Missing open infrastructure of information i.e. Data Catalogs → diffuclt to find Data Sets

● Poor technical structure for reuse of data

● Missing culture/attitude/reward and target setting models to open data



Part 3Vision 2020



WEB 2020

Tommi Mikkonen, Antero Taivalsaari



Idea of Pöyry



Mashup w/ Qt

Tommi Mikkonen



Vision 2020

OpenStreetMap.org

Database

Metadata

Mashup

Location People Job

Data Catalog =Interface to Russia

Data Catalog

Open Data+

Mashup =

Innovations

Information

Knowledge

Wisdom

Data

Solutions for Asymmetric Information!

SignalingScreening

Maximum mutualInformation/Channel capacity

(c) 2011 Luuppala, Kamppuri



Thank you!

Documents

Open Data