Upload
doannhu
View
220
Download
1
Embed Size (px)
Citation preview
ICSU World Data Center for Geoinformatics and Sustainable Development as a platform for interdisciplinary research
ICSU World Data System worldwide «community of excellence» for multidisciplinary scientific data
105 Member Organizations 68 Regular Members, 11 Network Members, 8 Partner Members, 18 Associate Members
WDS Scientific Committee: Sandy Harrison (Chair), Ingrid Dillo (Vice-chair), Wim Hugo (Vice-chair), Aude Chambodut, Alex de Sherbinin, Arona Diedhiou, Claudia Emerson, Elaine M. Faustman, Toshihiko Iyemori, Guoqing Li, Sanna Sorvari.
Ex officio: Heide Hackmann (ICSU), Yasuhiro Murayama (NICT) http://icsu-wds.org
TRUSTED DATA SERVICES
FOR GLOBAL SCIENCE
Goals • Enable universal and equitable access to
quality-assured scientific data, services, products and information
• Ensure long-term data stewardship • Foster compliance to agreed-upon data
standards and conventions • Provide mechanisms to facilitate and improve
access to data and data products
Initial System Architecture & Functional Structure
ICSU-WDS is an interdisciplinary global federated system of long-term data archives and data services. Roles in the system encompass the entire data management chain, from data production to publication, and WDS Members can hold a number of these roles. Emphasis is also placed on linking with data production facilities, in particular, science projects and programmes.
http://icsu-wds.org
WDC-Ukraine establishment
WDC-Ukraine creation Decision of - Presidium of National Academy of Sciences of Ukraine, - Ministry of Education and Science of Ukraine and - Geophysical Center of the Russian Academy of Sciences
2006
WDC-Ukraine certification as WDS member
2011
Memorandum of Understanding between the International Council for Science (ICSU)
and the World Data Center for Geoinformatics and Sustainable Development (WDC-Ukraine)
Main science directions
• Geoinformatics • Sustainable Development
• Modeling of complex systems of different nature, incl. social, economic, environmental systems and processes
Main activities • Provision of all main phases of data management
(collection, quality assurance, storage, processing, sharing, reporting and long-term stewardship) for scientific data of various nature.
• Development of mathematical models, methods and tools for assessment and decision-making in complex systems.
• Development and support of information systems and services focused on data analysis and processing.
WDC Structure
• Laboratory of Computer Modeling and Data Mining • Laboratory of Geographic Information Systems • Laboratory of Econometrics and Forecasting • Laboratory of space data • Laboratory of international scientific and educational
projects • Laboratory of system analysis of financial markets
(with Institute for Applied System Analysis)
• Laboratory of environmental sustainability monitoring (with Department of Cybernetics of Chemical Technology Processes)
• Laboratory of the global economy, regional research and microeconomics (with Department of International Economics)
• High Performance Computing Centre • Engineering Group • Administrative group
Institute of Geography
of NAS of Ukraine
cartography data
Main Astronomical Observatory
of NAS of Ukraine
space geodesy and geodynamic; ultrarays; sun information
Chornobyl Center for Nuclear
Safety, Radioactive Waste and
Radioecology
data on radiation, ecological, and medical consequences of
the Chornobyl catastrophe (Shelter Safety, Health and
Radioecological Consequences)
Institute for Applied System Analysis
basic and applied research in the field of methodology of system analysis of complex objects and processes of social, economic, environmental and technological directions
Institute of Geophysics
of NAS of Ukraine
seismology, gravimetry, thermal stream, arkheo- and paleomagnetism, magnetic
measuring, current motions
Scientific Center for Aerospace Researches
of Earth
aerospace pictures for the use in geology, ecology, rural,
forest and water economy, prognostication of global
changes of environment and catastrophes
WDC-UKRAINE
New model for multidisciplinary WDC was defined as "network of networks" 21st Int.CODATA Conf., 2008, Kyiv, Ukraine
Network of Networks
Central Geophysical Observatory
Hydrology, hydrography, meteorology and climatology, environmental pollution
http://wdc.org.ua
Research infrastructure
Geographically dispersed nodes High performance computing cluster
HPCC Structure System 1: • Sites:
44 nodes with two Quad-core Intel Xeon E5440 @ 2.83 Ghz processors and 8 GB of RAM 68 nodes with two Dual-core Intel Xeon 5160 @ 3.00 Ghz processors and 4 GB of RAM
• Data exchange network: InfiniBand • Disk space: 6 Tb distributed file system based on the LustreFS • Capacity: 7, peak linpack TFlops • ОС: CentOS release 5.2 • MPI: openmpi 1.2.8 • The local resource manager: Slurm • Access protocol: SSH
System 2: • Sites: 16 nodes with two Quad-core Intel Xeon E5345 @ 2.33 Ghz processors,
8 GB of RAM and disk capacity of 500 GB • Data exchange network: InfiniBand • ОС: MS Windows Server 2008 HPC Edition • MPI: MS MPI 2.0.1551 • The local resource manager: HPC Job Manager • Protocol access: RDP
Node motherboard supports IPMI interface for remote control. Data storage system includes the following components: • 6Tb + 6.5 Tb of space on the base of FalconStor storage systems • 20 Tv space in strip archive
• Distribute data • share data • control access • establish copyright • promote
data
• Follow-up research • new research • undertake research reviews • scrutinize findings • teach
and learn
• Design research • plan data management (formats, storage etc) • plan consent for sharing, locate existing data
• collect data (experiment, observe, measure, simulate)
• capture and create metadata
• Enter data, digitize, transcribe, translate • check, validate, clean data
• anonymity data where necessary • describe data
• manage and store data
• Interpret data • derive data
• produce research outputs • author publications
• prepare data for preservation
• Migrate data to best format &suitable medium
• back-up and store data • create metadata and documentation • archive data
Creating data
Processing data
Analyzing data
Preserving data
Giving access to data
Re-using data
Link: http://www.data-archive.ac.uk/create-manage/life-cycle
CONTINUOUS LIFE CYCLE OF RESEARCH DATA
BI & Analytics Platform of WDC-UA
Basic • Online Single Page Application (SPA) design • SPA Hosting • Widget based dashboards • Widgets interaction • Flexible navigation • Flexible page layout (device independent) • Skins, full app internalization (without reload),
management of app resources • User collaboration support • Apps Access policy
Advanced • Toolkit for Apps Management (ready to use) • Toolkit for Data Management: Reach metadata support (tags,
categories, lookups), full dataset internalization, dataset version service, data uploads/downloads (ready to use)
• Toolkit for Data Analysis & Visualization: multidimensional data cube manipulation, data queries (projections, selections, joins), interactive charts, multilayered maps, tables, embedded data processing and data mining (ready to use)
• Toolkit for Project Management (implementation stage)
Key features Pilot version: http://open.wdc.org.ua/app/SDI/
Analysis of Complex Social, Economic and Ecological Systems
• Cointegration for data of different nature • Working with unstructured information • Developing methods and models for data
quality estimations, filling of empties and data-based forecasts. • Validity check of data using regression analysis
and filtration. • Clasterization and sampling for dig data. • Modelling optimal strategies based on object’s
previous behavior estimations. • Data mining for big data in conditions of strong
time limitations.
Multivariate exploratory techniques
Normalizing
Filtration
Dependence analysis and reduction of models
Dependency Analysis
Investigation of causality
Design of influence diagrams
Estimation of model parameters
Definition of intervals for data visualization
Reduction of the parameter space and the choice of projections
Gaps in Data Processing
(missing data)
Formal Clusterization
Formal interpretation of causality
Dependency Analysis
Development of indicators
Development of indicators
Development of indicators
Gaps in Data Processing (missing data)
Gaps in Data Processing (missing data)
Gaps in Data Processing (missing data)
Error Estimation
Analysis of reliability and validity
Development of indicators
Basic Statistics
Goodness-of-fit test
Principal Component Analysis
Factor Analysis
Bayesian Networks
Entropy Analysis
Correlation Analysis
Clusterization
Regression Analysis
Advanced / Big Data Analytics
• Statistics • Optimization • Uncertainty quantification • Machine learning • Network and graph analysis • Analysis of streaming data • Data reduction
(incl. dimension reduction, feature extraction and topological methods)
Research Projects and Grants 2012 - 2013 The development of tools for multi- complex models building (0112U000557) 2013 - 2018 DFATD funded project “Laying the Foundation for a Spatial Data Infrastructure: Building
Capacity within the Ukrainian Government to Support Sustainable Economic Growth” (S-065681)
2014 - 2015 The development of tools for the analysis of municipalities’ sustainable development (0114U000671)
2014 - 2016 Methodology of quantitative evaluation and analysis of a k-society development (0114U000670)
2015 - 2016 A system approach and implementation methods for technical-communicational component of strategic environmental assessment in context of adaptation to regional climate change (0116U006141)
2016 - 2016 SSE Chornobyl NPP Status Monitoring (130516) 2016 - 2017 Foresight Analysis of future economy of Ukraine for midterm (2015–2020) and longterm
(2020–2030) time horizons 2016 - 2017 Development of information technologies for modeling, quantitative evaluation and
forecasting the impact of the threats of conflicts and weapons proliferation on sustainable development of the society in regional and global contexts (STCU #6166)
2017 - 2019 Development of an online platform for analysis and scenario planning of sustainable development of the regions of Ukraine in the context of the quality and safety of human life (0117U002476)
Annual analytical reports
http://wdc.org.ua
Analysis of sustainable development: global and regional contexts Foresight Analysis of future economy of Ukraine for midterm (2015–2020) and longterm (2020–2030) time horizons
Foresight and construction of the strategies of socio-economic development of Ukraine on mid-term (up to 2020) and long-term (up to 2030) time horizons Done SWOT-analysis of 10 drivers (clusters) of Ukraine's economy and
its socio-economic segment, as an integrated system. Using the SWOT analysis techniques, the method of "two axes" and the
method of "branch" the 8 scenarios of socio-economic development of Ukraine for 2030 were created.
The influence of external and internal factors (events) to the level of social transformations in Ukraine through measurement differences (angle) between the vector of the government's actions and the vector of social activity of society was estimated.
Fifty-lined main actions of the government in the form of socio-economic development strategy of Ukraine were constructed.
These results may be used by decision makers at the state level, civil society institutions and international organizations for defining rational policy and constructive plans of social and economic development of Ukraine for mid-term and long-term time prospects.
http://wdc.org.ua/sites/default/files/WDC-IASA-FORESIGHT-2016-EN.pdf
Foresight Analysis
Indicator models
Hierarchical system of indicators and indices (>80 datasets).
Sustainable development Index 2016
Index of Ecological dimension Environmental threats
The index covers 15 indicators, in particular
The index of drinking water quality Indicator of radiological condition of the
territory (за 137Cs, 90Sr, 238+239+240Pu)
Indicator of the carbon trend of the regional economy
Sustainable Development Index 2016 Country Ranking
10 lead countries Germany Australia Switzerland Sweden Canada Denmark Norway Netherlands Finland Japan
10 last countries Kenya Mozambique Angola Philippines Ukraine Syria Nigeria Central African Republic Pakistan Yemen
Chornobyl NPP Status Monitoring Project tasks: • Inventory and cataloging of information resources SSE
"Chornobyl NPP" to organize interactive search by subject classifications.
• Publication of information and deployment of databases of Chornobyl NPP in the ICSU World Data System.
• Development and implementation of information and technical means to collect, exchange and sharing of information in the field of decommissioning nuclear power reactors, radioactive waste management, nuclear safety, the transformation of "Shelter" into an ecologically safe system, rehabilitation of contaminated areas.
• Exchange of scientific information and data on the basis of software standardization, interoperability, meta descriptions and continuous actualization of data based on international standards and requirements of the World Data System.
• Using communication equipment and server hardware, data warehousing and application software of WDC-Ukraine for the collection, storage, and archiving of SSE "Chornobyl NPP" data.
Prediction of Air Pollution Nitrogen dioxide in Kyiv
The relationship between ground observations data and remote sensing data NO2
Correct with using research tool for value of measuring pollution NO2.
Dynamics of change of air pollution index by cities of 1992 - 2013
Building of Architecture Geoinformation Systems
• Geodatabase development • creation of applications
• Web geoservices processing and services
Competence World Data Center in GIS Spatial Data Analysis:
geostatistical analysis machine learning Spatio-temporal clustering Geographically Weighted Regression
PPRD‐East Project Title • Programme for the Prevention, Preparedness and Response to
Man‐Made and Natural Disasters in the ENPI East Region (PPRD‐East) – EuropeAid/129397/C/SER/Multi
Countries: • Armenia, Azerbaijan, Belarus, Georgia, Moldova, Ukraine
Project purposes: • To contribute to the development of the Partner Countries' civil
protection capacities for disaster prevention, preparedness and response
• To bring the Partner Countries progressively closer to the EU Civil Protection Mechanism and improve cooperation among themselves.
WDC-Ukraine tasks • Developing geospatial database for determination of
characteristics of critical infrastructure • Estimation of asset characterizations of critical Ukraine
infrastructure on the base of overlay analysis using geospatial layers
• Developing the Critical Asset map for territory of Ukraine
2011-2014
Web Atlas "Sustainable development"
Catalog of remote sensing open data
The catalog contains open data of thematic processing of remote sensing for Ukraine, which sorted the following areas: • Land Cover • Nature resources • Environmental issues
Vancouver Island University, Canada Taras Schevchenko National University of Kyiv, Ukraine National Technical University of Ukraine, “Igor Sicorsky
Polytechnic Institute", Ukraine
Laying the Foundation for a Spatial Data Infrastructure: Building Capacity within the Ukrainian Government to Support Sustainable Economic Growth
Primary Project Goals
• Preparation of certified professionals for key government agencies in the fields of GIS and Spatial Data Infrastructure (SDI)
• Transfer of Canadian experience in the field of training for SDI
• Help to establish an educational centre located at the NUK and NTUU “KPI”, which provides educational and scientific expertise for the Ukrainian SDI
Main Immediate Outcomes
• Six NUK and NTUU “KPI” instructors trained in technologies to support the Ukrainian NSDI
• Six course curricula on SDI developed, adapted, and translated
• Approximately 100 civil servants (70 female and 30 male) trained and certified in Spatial Data Infrastructure and Geomatics technologies
Professional community "Geomatics"
120 members, 25 organizations and 10 regions Expert advice in the field of GIS and Geomatics 6 training courses 22 scientific, educational and applied projects
Links
• http://wdc.org.ua • http://wdc.org.ua/activities/Service/StatPlanet.html • http://wdc.org.ua/~atlaswdc • http://wdc.org.ua/data_analysis/ • http://wdc-app.cloudapp.net/app/Slavytych/ • http://wdc-app.herokuapp.com/app/Pollution/pol3 • http://wdc-app.cloudapp.net/app/sustainable-
development/threats
Contacts World Data Center for Geoinformatics and Sustainable Development http://wdc.org.ua [email protected] Address: 37, Peremohy ave., 03056, Kyiv, Ukraine. Phone: (+380 44) 204 80 14 Fax: (+380 44) 204 8153
Any questions?
Thank you for your attention