42
Hey, it's THE PEOPLE'S data! The global emergence of the Open Data Movement Tom Johnson Managing Director Institute for Analytic Journalism Santa Fe, NM [email protected] 1

It's the people's data

Embed Size (px)

DESCRIPTION

Presentation at the Santa Fe Complex, 5 Oct 2001

Citation preview

Page 1: It's the people's data

Hey, it's THE PEOPLE'S data! The global emergence

of the Open Data Movement

Tom JohnsonManaging Director

Institute for Analytic JournalismSanta Fe, NM

[email protected] 1

Page 2: It's the people's data

2

Presented at the Santa Fe Complex5 Oct. 2011

Slides may be found athttp://opendatanm.pbworks.com

It's the people's data by J. T. Johnson is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs

Page 3: It's the people's data

3

Cause for optimism?

• "All agencies should adopt a presumption in favor of disclosure."

• "We must operate state government in an open and transparent manner."

Page 4: It's the people's data

4

• "All agencies should adopt a presumption in favor of disclosure."

Barack Obama. "Freedom of Information Act: MEMORANDUM FOR THE HEADS OF EXECUTIVE

DEPARTMENTS AND AGENCIES."

• "We must operate state government in an open and transparent manner.“

Susana Martinez. "Ensuring Transparency and Ethics in Our Government."

Page 5: It's the people's data

5

Tonight’s Objectives

• Part of the SFX series "What's happening now?“

• Brief interested citizens and journos on potential for citizen control of our data

• Test the water to see if others in SFe might be interested in building a "Get our data" project

Page 6: It's the people's data

6

Objectives - "It's The People's data."• Basic Process:

Data In Analysis Info Out• Facilitate transparency, participation,

collaboration, economic development • Create greater efficiency and utility for public

administrators • Create a culture in government and public

administration that assumes The People's Data will be quickly online in its original file format.

• Educate citizens on how to identify, retrieve, analyze and present data

Page 7: It's the people's data

7

Backstory & Assumptions

• It IS the people's data• Changing Functions of gov't.• Fight against the "data huggers"

• An informed electorate is better than uninformed

• Full political spectrum can agree on importance of data (if not interpretation)

• The technology is relatively easy; changing the culture is hard

• Supply analytic tools if possible, i.e. sort and array, GIS, visual stats

Page 8: It's the people's data

8

Assumptions

• Default: Post all gov't data in original file format as soon as possible• Make as easy to download in original format as

possible

• Yes, there are/will be privacy issues• But start with “put the data up”• Then ask, “OK, is there going to be

anything here that encroaches on an individual’s privacy?”

Page 9: It's the people's data

9

Why timely?

• “The Big Bundle” examination of NM voter rolls• Clean up registered voter list• 64k “questionable” voters on roles• Outcome always determined by methodology

• Santa Fe Public Schools performance data"Zero Sum: School district 'erased' low achievers to improve data"

• PRC expense report data• PRC activates gas-card alerts

Page 10: It's the people's data

10

Open Data Movement is NOT about…

• technology alone or• building a portal or• transparency for the sake of transparency.

Page 11: It's the people's data

11

Greater benefits of open data…

• Increased internal government efficiency and effectiveness

• Increased citizen participation and inclusion with more services closer to people’s needs

• More services to people because of increased base of more potential service providers

• New businesses/jobs for application and service developers

• Synergies between government, public administration and civil society organizations

• New uses of open data spur innovation and development in the CIT sector

Page 12: It's the people's data

12

Development Seed

12

Page 13: It's the people's data

13

About Moscow city administration opendata plans

• “I would like to lauch public discussion here in Russia about city data openness and to civil oversight over city administration activities.So could you help me please with information about similar city projects around the world ? I know that there are Toronto, Chicago, Berlin and dozen other city opendata projects.If you know about any city level opendata portal, could you tell me about:> - how long time it takes to create it and to make it public?

Page 14: It's the people's data

14

Int’l examples

• Ukraine -

Page 15: It's the people's data

15

International

• from: Ann Frisch [email protected]: Wed, Sep 21, 2011 at 2:33 PMsubject: Re: [open-government] open-government Digest, Vol 19, Issue 28mailing list: open-government.lists.okfn.org

“I would like to get together with Open Data members from South Sudan, Philippines and South Caucasus region to what is being done in those areas in terms of open data.”

Page 16: It's the people's data

16

Open Government Data Camp 2011

http://ogdcamp.org/cfp/What: The world's biggest open data event to date.  * When: 20-21st October, with satellite events from 17-26th October  * Where: Warsaw, Poland  * Web: http://www.ogdcamp.org  * Hashtag: #ogdcamp

•The camp has 4 key objectives:  * Build consensus – around core open data principles and values  * Build community – expand and strengthen international open data community  * Share ideas – on the future of open data and how we can do things better  * Make things – from starting projects, to making plans, to writing code

Page 17: It's the people's data

17

Open Government Data Camp 2011

http://ogdcamp.org/cfp/What: The world's biggest open data event to date.  * When: 20-21st October, with satellite events from 17-26th October  * Where: Warsaw, Poland  * Web: http://www.ogdcamp.org  * Hashtag: #ogdcamp

•The camp has 4 key objectives:  * Build consensus – around core open data principles and values  * Build community – expand and strengthen international open

data community  * Share ideas – on the future of open data and how we can do things better  * Make things – from starting projects, to making plans, to writing code

Page 18: It's the people's data

18

Culture “hacks”

Page 22: It's the people's data

22

Hacks and Hackers chapters

Page 23: It's the people's data

23

What’s the process? Where’s the data?

Data In Analysis Info Out

Page 24: It's the people's data

24

• TWC International Open Government Dataset Catalog (IOGDChttp://logd.tw.rpi.edu/demo/international_dataset_catalog_search

Page 25: It's the people's data

25

Open Data Showroom - http://opendata-showroom.org/

Page 26: It's the people's data

26

AskTheEU.org

26

Page 28: It's the people's data

28

OpenlyLocal.com

Page 29: It's the people's data

29

Hyperlocal Sites in UK & Ireland

Page 30: It's the people's data

San Francisco: Data Sharing Among City Departments and Agencies

3030

Page 31: It's the people's data

31

International

Excellent meta-data

31

Page 33: It's the people's data

33

Santa Fe .gov

33

Page 34: It's the people's data

34

Data search and retrieval

• What is the law?• NM Foundation for Open Government• Records Retention Schedules and Their

Use• NM Statute 1.13.30 authority of state

records administrator• May be policies unique to

agency/department

• NM “Inspection of Public Records Act”• FOG: http://nmfog.org/Recent_Changes_to_IPRA.aspx

Page 35: It's the people's data

35

Retention of local gov’t records

• New Mexico - Local Government Records Retention and Disposition Scheduleshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C019.htm

Page 36: It's the people's data

36

Retention of NM state gov’t records

• Administrative Records for state agencieshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C015.htm

• Executive recordshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C018.htm

• Legislative recordshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C016.htm

• Judicial recordshttp://www.nmcpr.state.nm.us/nmac/_title01/T01C017.htm

• 1 NMAC 3.2.50.1, Destruction of Public Recordshttp://www.nmcpr.state.nm.us/nmac/parts/title01/01.013.0030.htm

Page 37: It's the people's data

37

Data search and retrieval

• What is the document?• Origins?

• Who created? When? Why? How?• Verification? Who? When? Why?

• File type(s)• Analysis often limited by PDF files; • Always seek document/data in its original file

format• Strive to get the “metadata” of the

document/data

• If spreadsheet or database, request “code sheet” or “database schema”

Page 39: It's the people's data

39

New, major function for government in the Digital Age

Page 40: It's the people's data

40

Next steps?

• Remember: Data InAnalysisInfoOut• Room for all skilled and yet-to-be skilled• Scaleable local to state

1.Create “jump station” database of all NM “records custodians” for all levels of government

2.Build catalog of gov’t agencies/depts. data1.State and local library initiatives to submit

their data?

Page 41: It's the people's data

41

Next steps?

• Anyone interested in OpenData-NM?• Fill out info card• Recruit others

• Visit “rough sketch” wiki – o p e n d a t a n m . p b w o r k s . c o m

• Make suggestions• Step up to develop/manage a pertinent

project

Page 42: It's the people's data

Hey, it's THE PEOPLE'S data! The global emergence

of the Open Data Movement

Tom JohnsonManaging Director

Institute for Analytic JournalismSanta Fe, NM

t o m @ j t j o h n s o n . c o m

Slides may be found athttp://opendatanm.pbworks.com

42