Remote sensing and augmented virtuality technologies for detection

Remote sensing and augmented virtuality technologies for detection, identification and monitoring of

environmental risks in port areas

Valencia, April 22-23

ICT innovations in shipping and Smart Port Management in the Mediterranean area Valencia, April 22-23

Some brief ideas: the problem



• There are many more unknown oil spills • Some of them are less important in terms of tons of crude oil, but very important in terms of impact on the economy, social response and environmental degradation



Oleg Naydenov (2015) 27 Kms South Gran Canaria 1400 tons of oil in its tanks

Can

ary

Isla

nd

s



• There are many more unknown oil spills • Some of them are less important in terms of tons of crude oil, but very important in terms of impact on the economy, social response and environmental degradation • Areas related to higher maritime transport are more susceptible to these accidents • The oceans cover 71% of the total surface of the earth (362 millions Km2) and it is impossible to monitoring every Km of this huge area • ICTs are needed in order to alleviate this monitoring task

• It has to be effective • Detect different constituents of spills • Identify different constituents of spills • Fast response • Avoid false positives • Cover as much area as possible



• There are many more unknown oil spills • Some of them are less important in terms of tons of crude oil, but very important in terms of impact on the economy, social response and environmental degradation • Areas related to higher maritime transport are more susceptible to these accidents • The oceans cover 71% of the total surface of the earth (362 millions Km2) and it is impossible to monitoring every Km of this huge area • ICTs are needed in order to alleviate this monitoring task

• It has to be effective • Detect different constituents of spills • Identify different constituents of spills • Fast response • Avoid false positives • Cover as much area as possible


Some brief ideas: combining different technologies

• Sensors: visible, infrared, ultraviolet, radar, microwave, laser fluorosensor, multi/hyperspectral… • False positives: seaweed, shoreline, sun glint, wind sheen, biogenic materials… • No single sensor can give exact information required for the detection and hence a combination of some of them are mandatory • Fusion techniques






Isle of Wight, South UK Radar image. Sentinel-1 satellite June 26th, 2005



COPERNICUS Programme • Based on a new family of missions called Sentinels • Each Sentinel mission is based on a constellation of two satellites to fulfil revisit and coverage requirements, providing robust datasets for Copernicus Services • Sentinel-1, with radar technology for land and ocean services. Sentinel-1A (April 2014), Sentinel- 1B (April 2016) • Sentinel-2, multi-spectral high resolution imaging for land monitoring and coastal areas. Sentinel-2A (June 2015), Sentinel-2B (second half of 2016) • Sentinel-3, multi-instrument mission for ocean forecasting, environment and climate monitoring. Sentinel-3A (February 2016), Sentinel-3B (2017) …

Isle of Wight, South UK Radar image. Sentinel-1 satellite June 26th, 2005




“Recent studies demonstrate the utility of hyperspectral imagery, although at present the interpretation of hyperspectral datasets requires specialized expertise. Automating the information extraction process used will make it easier to integrate hyperspectral sensor output into operations”

Report from Joint Industry Programme to define the state-of-the-art for surface remote

sensing technologies to monitor oil under varying conditions of ice and visibility. 2015.







Sony playstation VR Samsung Gear VR Microsoft HoloLens


Some brief ideas: combining different technologies Augmented virtuality: Human friendly environment visualization

Any point of view, at any time, in any weather condition Real information overlaps the virtual world Real Sensors/Actuators have equivalent Virtual Sensors/Actuators Real Cameras have equivalent Virtual Cameras Ships, trucks, people, etc. geo-located is represented by 3D avatars showing its

position/state at real time. Integration of Information and data fusion with a 3D representation for better situation

understanding. Enables event interpretation and complex situation understanding Facilitates normal/crisis monitoring and management Fuel tanks, warehouses, port facilities, etc. are showed with logistic information.

Real scenario

Virtual 3D world




Horizon 2020. Work Programme 2016-107

11. Smart, green and integrated transport 7. Infrastructure MG-7.3-2017: The port of the future

• Re-engineering of port operational processes via process analysis and identification of interoperable ICT systems to improve the level of integration among all actors (Port Authorities, terminal operators, shipping companies, customs, security forces, etc.) and facilitate critical decision-making • They (ports) are a main catalyst for regional development and their optimisation and inclusion in the territory is fundamental to ensure that efficient operations will not affect negatively the surrounding areas.

Specific challenge

• Identification of real-time indicators to improve the quality of services provided • Low environment impact, climate change adaptation, and moves to a circular economy • Advanced and efficient links and integration in the socio-economic industrial and urban surrounding environment

Scope



14. Secure societies – Protecting freedom and security of Europe and its citizens Disaster-resilience: safeguarding and securing society SEC-01-DRS-2016: Integrating tools for response planning and scenario building

• At present, the wide range of sectors, disciplines and actors involved in disaster risk management are not sufficiently interlinked… • Integrated tools need to be developed to support such actions • Stronger partnerships among research, policy, (research or monitoring) institutes, industry/SMEs communities and practitioners… are required for better preparedness of societies to cope with complex crisis situations

Specific challenge

• Disaster risks (natural, accidental, or intentional) should be addressed in the context of: EU Civil Protection Mechanism, the IPCC and the Sandai Framework for Disaster Risk Reduction at international level

Scope



14. Secure societies – Protecting freedom and security of Europe and its citizens Disaster-resilience: safeguarding and securing society SEC-01-DRS-2016: Integrating tools for response planning and scenario building

• Disaster risks (natural, accidental, or intentional) should be addressed in the context of: EU Civil Protection Mechanism, the IPCC and the Sandai Framework for Disaster Risk Reduction at international level • Response to emergency situations resulting from the materialization of such risks requires inter-organisational coordination among many actors… • This can only be achieved through the integration of support tools that can be used… • Such tools can be build upon previous and ongoing FP7 projects… • Participation of SME is strongly encouraged • International cooperation is encouraged • TRL 7 or 8

Scope (continuation)


5 key questions

• Why fusion of different sensor tecnologies? • Why hardware/software solution? • Why augmented virtuality? • Are there similar initiatives in Europe? • Why a pilot project like this in the Canary Islands? • What partners profile do we need to get success?

PLOCAN Maspalomas Space Station Las Palmas de GC port

José Fco. López Instituto Universitario de Microelectrónica Aplicada (IUMA) Universidad de Las Palmas de Gran Canaria [email protected] Tfno. +34.928.451243

Juan Carlos López Grupo de Arquitectura y Redes de Computadores (ARCO) Universidad de Castilla La Mancha [email protected] Tfno. +34.926.295426

Documents

Remote sensing and augmented virtuality technologies for detection