Embed Size (px)
Citation preview
07 November 2017, Brussels730227
SCRREEN & the RMIS 2.0
Raw Materials Week
Annual Critical Raw Material Event
Daniel Cassard - BRGM
SCRREEN
SCRREEN knowledge management
SCRREEN manages both structured data (from database) and unstructured data(reports, stats, images…).
SCRREEN is developing a CRM Knowledge Data Platform, the EU-CRMKDP. This isthe SCRREEN DATA/DOCUMENT MANAGEMENT SYSTEM or DMS.
This CRMKDP is connected to the MICA Expert System. This is the SCRREENDECISION SUPPORT SYSTEM or DSS.
SCRREEN builds on former and ongoing projects, taking advantage on thedevelopments made in Minerals4EU, EURare, ProSUM and MICA, and implementingnew techniques like Data Augmentation.
SCRREEN
WP9: Knowledge Management
The DMS: data / documents management
system
What is a distributed architecture? Pros & cons…
How to feed the Knowledge Base?
How to retrieve information?
SCRREEN
Web
Services
REEInfo
MR
Info
Web
Services
Non-, semi- & structured /
standardized information
related to MR & wastes:
knowledge extraction,
indexation…
Ne
w k
now
ledg
ep
rod
uced
by p
art
ners
fro
m
oth
er
wo
rkp
acka
ge
s
Information Factorydata filtering, advanced search,
statistics computing,
report generation
Layers
Web
Services
Pertinent available layers
from geological surveys
and EU projects and
other institutions (e.g.,
geographic, geological,
geophysical,
geochemical maps)
…YX
…YYXX
Web
ServicesWeb
Services
Web
ServicesWeb
ServicesWeb
Services
Web Services
General simplified architecture of the EU-CRMKDP
Other agencies, institutes, professional
associations…, able to provide structured data
Documents & Metadata
Structured data provided by geological surveys
Based on OGC/
INSPIRE
Implementing
Rules for
Services and
Data
A distributed architecture asustainable system always kept up to date.
Management of:
- non-structured data, always accompanied by their metadata;
- structured data.
A system fully INSPIRE compliant, based on INSPIRE v.3 and ERML v.2.
A Central Database to minimize the drawbacks of the distributed architecture: improves the performance, reduces the risk in case of server crash
SCRREENProvider’s own format
Mapping (ETL process and code lists)
Harvesting DB(+ quality control)
Project DB
Diffusion DB(+ diffusion optimizations)
Documents & Metadata
Web Services(WMS/WFS)
Web Services(Search engine)
Web Services(Stats, auto report, filtering…)
DB SYNCHRONIZATION
Standardized data models
(INSPIRE MR, ERML)
Harvesting
mechanism
(ETL process)
INFORMATION FACTORY
EU-CRMKDP detailed architectureBased on a « production-diffusion schema »
WebServices
National DB
Provider DB
National DB
Provider DB
Indexation
Provider DB
Deegree 3
MICKA Catalog(CS/W)A professional
architecture: A Central Harvesting Database synchronized with a Central Diffusion Database. The first one controls data quality and the second one is optimized for diffusion. Synchronization is made using SQL scripts.
EU level
Country
levelWeb
ServicesWeb
Services
SCRREEN
The dedicated application for feeding the
Knowledge Base and retrieving information
(1/5)
A dedicated application to upload (or link) documents and their metadata (Dublin
Core format – 15 mandatory fields)
SCRREEN
The dedicated application for feeding the
Knowledge Base and retrieving information
(3/5)
The Data Search capabality allows
searching like in Google (full text), using specific fields, geographycally (drawing a polygon),
and also in structured data (Ore deposit
database – currently under development)
SCRREEN
The dedicated application for feeding the
Knowledge Base and retrieving information
(4/5)
Retrieve documents, see related metadata and get the document
SCRREEN
The dedicated application for feeding the
Knowledge Base and retrieving information
(5/5)
Get the info related to a deposit directlyfrom the viewer
SCRREEN
The DSS: decision support system
Will use and improve the H2020 MICA ontology-based Dynamic DecisionGraph (DDG). An ontology allows specifying in a formal language (machineunderstandable) the concepts of a domain of interest and their relationships.
The DDG allows the end user to search for the most appropriate method(s) and tool(s) to use for resolving his problem.
The first functionality of the DDG is not to be a ‘pure’ search engine.However, data, information and knowledge being strongly and cleverlyconnected, the DDG and its side applications can play the role of an ‘intelligent’search engine in the Raw Materials domain, and also act as a powerful decision-aid tool.
SCRREEN
RMICP Architecture
RDF (Resource Description Framework) is a standard model for data interchange on the Web. RDF has features that facilitate data merging even if the underlying schemas differ.
A triplestore or RDF store is a purpose-built database for the storage and retrieval of triples through semantic queries. A triple is a data entity composed of subject-predicate-object, like "Bob is 35" or "Bob knows Fred".
The MICA Main Ontology actually covers 7 thematic domains: ‘Primary’ and ‘Secondary MineralResources’, ‘Industrial Processing and Transformation’, ‘Raw Materials economics’ (includingCRMs), ‘Raw materials Policy & Legal Framework’, ‘Sustainability of Raw Materials’ and‘International Reporting’, representing about 300 concepts and sub-concepts.
MICASheetEditor
SCRREEN
The Dynamic Decision Graph
Web
ServicesWeb
ServicesWeb
Services
National DBNational DB
National ProviderNational ProviderNational Provider
National DB
‘Minerals4EU’
Harvesting DB
(+ quality control)
Mapping (ETL process and code lists)
Standardized data models (INSPIRE MR, ERML)
Direct extractionScattered data
Harvesting
EURare
Minerals4EU
SCRREEN
ProSUM
- REE- Continental primary and secondary resources- Continental resources at depth- Marine/offshore resources- CRM
Urban mine:- WEEE- ELV- Spent batteries
European
provider (e.g.,
Eurostat)
EU-UMKDP Web Portal EU-CRMKDP Web Portal
Diffusion DB
(+ diffusion
optimization)
Web Services(WMS/WFS)
Web Services(Search engine)
Web Services(Stats, auto report, filtering…)
Indexation
Documents & Metadata
MICKA Catalog(CS/W)
Toward the EURMKB:
A unified vision of
Knowledge
Management
The MICA
Expert
System
Methods & Tools
descriptions
e-Minerals Yearbooke-ProSUM Stat Modulee-SCRREEN applications
DB synchronization (SQL scripts)
Filter
r
Filter
r
Filter
rFilter
r
IKMS Web Portal EU-MKDP Web Portal
ProSUM
Harvesting DB
(+ quality control)Portrayal
HARVESTING FTP
Knowledge bases
ProSUM unified data model
Portrayal
Applications
JRC ‘RMIS’Working DB
RMIS 2.0 – SELECTED ROLES & TASKS
Ancient projects (FP5, 6, 7)Recent/current /forthcoming projects, incl. Eurostat
D DK
Data & Knowledge
PORTRAYAL
K
Applications
EURMKB
ORGANIZE NEW
KNOWLEDGEPUSH
STANDARDS
APPse-Min. YearbookMapse-Stats
Connected to the MICA Expert System
USGSBGSTNOEGSEEA
OECDESTAT…
External providers
WEB SERVICES
Toward end users
JRC ‘RMIS’ Safeguard DB
HELP END USERS
DISCOVERING DATA &
KNOWLEDGE
Roles
Tasks
PROVIDE END USERS WITH
KEY INDICATORS
APPsAPI Download……
APPsSEARCH……
MAKE MORE VISIBLE
EXISTING APPS
PRESERVE & SERVE
Spatial portal
MSA TRADECRM SCOREBOARD
Web interface
D
Create a JRC ‘RMIS’
Safeguard DB
Build a thematic interface for end
users
SEARCHcapability
07 November 2017, Brussels730227
GeoERA
EU-CRMKDP
RMIS
NGS
ProMine
EuroGeoSource
I’m a satisfiedEnd User
EU-MKDP IKMS EU-UMKDP
CRM
EU-RMICP
Ask a questionSearch for an information
NGS
NGS
Eurostat
Other possible databases
?? ?
ORAMA recommendations ( SC5-15c-2017)
Answer with a smart response Deposit& wastes REE
Urbanmine
Expertsystem
Answer retrieved fromthe dedicated system Q Q Q
A
Thematic interface
Can also directly calla dedicated system
Other
OTHER
Q
?
Query dispatched to the dedicated system
SCRREEN
RMIS 2.0
NGSNGS
NGS
► Common governance►Common architecture► Based on standards► Harmonised datasets► Optimized for diffusion
OR
AM
A –
DA
TA
SET
S O
PT
IMIS
AT
ION
Other projects…
Other datasets
. Continental geology
. Marine geology
. Mineral resources
. Geophysics…
The European Geological Data Infrastructure and the
RMIS 2.0
Other databases…
Extending the EGDI
WMS, WFS
RMIS 2.0 Thematic Interface
http://data.geus.dk/egdi/
