[Srijan Wednesday Webinar] Leveraging the OGD Platform and Visualization Engine

National Informatics Centre, MeityJune, 2017

OGD Platform Visualisation Engine and its use

Leveraging the OGD Platform and Visualization Engine

Open data is data that can befreely used, reused and redistributed

by anyone

Open Data

National Informatics Centre, MeitY

Need of Open Data

Citizen’s demand for Transparency and Accountability

Need for informed policy making/planning

Enhancing the relationship between Government & Citizen

Citizen engagement in policy making

Integrating stakeholders for governance process


Evidence-based Planning of socio-economic development processes rely on quality data

Government Collects, Compiles & Possess huge data (Crime Statistics, Prison Statistics, Census, Health Survey, Health Statistics, weather, Environment, market prices, Eco Indicators, price index, Demographic, Crime, survey, geo spatial data,.).

Often Little Used

Analyzed usually from one perspective

Possess huge untapped potential

Collected using tax payers money

Why Open Government Data?


Open Government Data : Potential Impact

Transparency

Accountability

Citizen Engagement

Collaboration

Better Governance

Better Decision making

Innovation


NDSAP was Gazette notified on 17th March 2012

Objective of the Policy

• Facilitate proactive Release of Data by the Government Departments/organizations

• For all the data and information created, generated, collected and archived using public funds provided by Government of India

National Data Sharing & Accessibility Policy (NDSAP)


Department of Science & Technology (DST) :

• Serve the nodal functions of coordination and monitoring of the policy


• Implementing Agency

• Formulate Implementation guidelines, technology & standards for data & metadata

• Design, Develop & Manage Open Government Data Platform (data.gov.in)

• Facilitate Identification & Publishing of datasets in Consultation with Departments

Ministry/ Departments/States…..

NDSAP: Key Stakeholders


Ministry/ Departments/States to

• Nominate Chief Data Officer- a Senior Government officers

• To drive open data in respective Deptts/ Orgns

NDSAP Cell• Members -

Domain, Data Analyst, Technology Personnel

• Assist in compile, collation, conversion & publishing datasets on OGD Platform in open format

Data Formats, Metadata Schema, Guidelines…

• Data Quality, Accessibility, Standardization

Workshops, Seminars, Stakeholder Engagement

• By NDSAP PMU through NIC

• Sensitization, Capacity building

• Citizen Engagement

• Challenges, Contests & Events

Implementation Approach

110 Chief Data Officer have been

nominated

1,00,000+Datasets

under 4157 catalogs by 105 departments

1000+ Visualizations have

been created

Datasets

11.4 Million times viewed &

4.7 Million times downloaded

446APIs

Statistics as on date

Government Open Data License – India

Government Open Data License – India has been developed to give legal frame work to the data consumers


https://data.gov.in/sites/default/files/Gazette_Notification_OGDL.pdf

Open Government Data (OGD) Platform India

Provisioning of a Platform to publish datasets proactively and provide open

access to data generated using public funds by departments/organizations of

Government of India

To increase Transparency, Accountability, Citizen Engagement, Collaboration,

Innovation and Better Governance through Data Driven Decision making

Paradigm Shift in Governance - Direct Delivery of Services to Citizen by Setting up this Platform for Collaboration Innovation


Resources (Datasets/Apps)

Cataloging as Service

Platform Software as a Service (SaaS)

Visualization Engine as

Service

Datasets APIs as a Service

Embed Catalogs Service

Widget to Consume/Link filtered set of

catalogs

Event Portal for OGD Events

OGD Community Portal for Blogs,

Visualization, Infographics

Suggest / Endorse Datasets

Showcase AppsControlled Vocabulary

Services

OGD Platform Features


Why Visualizations

Raw data alone can not provide the decision makers valuable insights

Real-world data are affected the presence of data noise

Data must be processed to provide any meaningful value

Visualizations make sense out of data

Choice of Visualization Type


Benefit of Visualizations

Data visualization helps the audience quickly absorb and interpret the presented data

Data visualization helps to take highly informed decisions quickly

Data visualizations is a process to interact directly with data

Improve efficiency of the communicated information

Simple way to trace data correlations & Identify trends

Geo Spatial Visualizations


National Informatics Centre, Meity


Process Flow of Visualization Engine

prFiles Uploaded In Any Format (csv, xls)

Create Instance Data is converted

to CSV

I

n

s

t

a

n

c

e

Instance ID is generated by

saving the Instance in DB

The Instance can be retrieved and proceed for

Next Step Of Visualization


Library

• D3

• NVD3

• C3.js

• Jvectormap

• leaflet.js

• openstreetmap

Retrieved Instances from DB,

comes as a Json File Chart/Map

User Filter/modify the data for the

view table according to the requirement

Json



Used Data after Filter/

Modification

If the user is already registered then the filtered/modified data would be saved in Database and the same visualization would

be reflected on view for the next time



Data in form of csv or Json

Visualization Engine

0246

Cat

e…

Cat

e…

Cat

e…

Cat

e…

My Data Tool

Copy and paste csv data or csv/json urldirectly to make chart/Map

Create, Share (only for visualizations created out of OGD data), Save, download chart/Map

Only registered user can save charts through visualization engine, when user will put his own data and proceed for save the chart, an instance ID with the user (ID) would be generated and would be saved on the visualization database

As per the setting by the user, the default charts would be saved or displayed accordingly



Features of Visualization Engine

Chart Type

D3

NVD3

C3.js

Bar

Stacked

Pie

Line

Area

Bubble

Line with view finder

Horizontal MultiBar

Multi Chart

Radar

Doughnut

Step

Library Used Map Type

jvectormaplibrary

India Map

leaflet.js and openstreetmap

State Map

LatLong Map

Library Used


D3js(Free+Open Source)

LicenseReleased under BSD license. Free to use as per as open source terms and conditions..

Features • D3.js is a JavaScript library for

manipulating documents based on data. D3 helps you bring data to life using HTML, SVG and CSS. D3’s emphasis on web standards gives you the full capabilities of modern browsers without tying yourself to a proprietary framework, combining powerful visualization components and a data-driven approach to DOM manipulation.

• D3 allows to bind arbitrary data to a Document Object Model (DOM), and then apply data-driven transformations to the document. For example, you can use D3 to generate an HTML table from an array of numbers. Or, use the same data to create an interactive SVG bar chart with smooth transitions and interaction.


Charts :

Choose any type of chart with any valid series/variable

Option to change the chart color

Customize title, labels and notes

Save, publish, delete, clone options

Complete view of the dataset

Option of Group function, Filtering, select needed fields to an instance to make chart

Transpose option

Show total number of charts in list with complete view

Share (only for visualizations created out of OGD data) and download option

Functionality of Visualization Engine

Maps:

Choose options from series to make map

Customized color for label, stroke, scale

Show bubbles on states according to the data

Save, publish

Zoom in/out option

Play/Pause/Stop option with time series

Share (only for visualizations created out of OGD data) and download option

Access the Create Visualization link from the home page of data.gov.in

Create Visualization


Visualization Engine : Way Forward


OGD Accolades

OGD Platform India has won Gems of Digital India Award, 2017

India had been ranked among Top 35 on the Global Open Data Index 2016

OGD Platform India has won the CSI-Nihilent e-Governance Awards for excellence for the year 2013-14

OGD Platform India has won e-India 2013 Award for e-Governance Initiative


OGD Awards


Follow OGD Platform

@DataPortalIndia

www.facebook.com/DataPortalofIndia

[email protected]


Contact Details:

Akhilesh Kumar SrivastavaSr. Technical Project ManagerMob: +91-9818079449Email: [email protected]

Shubhadip BiswasSr. AnalystMob: +91-9910453540Email: [email protected]

mailto:[email protected]

mailto:[email protected]

Data & Analytics

[Srijan Wednesday Webinar] Leveraging the OGD Platform and Visualization Engine