DEIMOS – 17 January 2005 1 Ontogrid Presentation OntoGrid Business Case, User Requirements Analysis…

DEIMOS – 17 January 2005 1 Ontogrid Presentation

OntoGrid OntoGrid Business Case, Business Case,

User Requirements Analysis User Requirements Analysis and and

Test Set Definition Test Set Definition For Quality Analysis For Quality Analysis

Platform Platform PresentationPresentation

((ontogrid-dms-ptt-001-11ontogrid-dms-ptt-001-11))

Ana Isabel Mediavilla


• Ontogrid Presentation:Ontogrid Presentation:

– Business Approach

– Quality Platform

– Use case I:Correlation products and mission status

– Use case II: Validation of an instrument based in their product files

• DiscussionDiscussion

AgendaAgenda


Ontogrid PresentationOntogrid Presentation

Presentation Presentation Meeting 17-19 Jan Meeting 17-19 Jan


• Business ProcessesBusiness Processes

– All business processes are in charge of monitor and control of a satellite or a set of satellites for getting valuable data (products) from the instruments. These data is for covering the mission of the satellite.

• Satellite is a hardware and software equipment with a concrete mission. For example: Mission from Satellites

• Instrument is a hardware and software component, which allows making measures of specific type.

– For example in Envisat: » Envisat Satellite with its instruments» Use of an instrument:http://envisat.esa.int/instruments/tour-index/asar

/animation_2.htm

• Mission is the objective of any element, in this case of the satellite. – For example in Envisat: Envisat data supports earth science research and

allows monitoring of the evolution of environmental and climatic changes.

• Products or product files are files generated by an instrument directly (level 0) or processed after being generated by an instrument.

Business (I/VIII)Business (I/VIII)

http://orbits.esa.int/orbits/eo/satellite/satellite.htm

http://envisat.esa.int/instruments/tour-index

http://envisat.esa.int/instruments/tour-index

http://envisat.esa.int/instruments/tour-index/asar/animation_2.htm











Navigation process(II/VIII)Navigation process(II/VIII)

Navigation process:Navigation process: Verify and control the navigation of the satellite.

Inputs: Inputs: Configuration data

Outputs: Outputs: Products files and auxiliary files

Actors:Actors: ·– MCS– PDS·– Satellite


Navigation process(III/VIII)Navigation process(III/VIII)

: PDS : QualityAnalysis&ReportGeneration : MCS : ConfigurationData&DataSatellite : Satellite

Distribute Quality Reports

Modification configuration: satellite and instruments

Store the configuration data from satellite

Send telecommands

Send telemetry

Store product files

Build product files from telemetry and processing of telemetry


Quality process (IV/VIII)Quality process (IV/VIII)

Quality process: Quality process: Monitorization and control of the instruments included in the satellite and all the parameters involved in the data acquisition.

Inputs:Inputs: Products files and auxiliary files

Outputs:Outputs: Reports for “Research and developers”.

Actors: ·Actors: ·– PDS·– Research and

Development·– DEIMOS– ESA Maintenance


Quality process (V/VIII)Quality process (V/VIII)

DIM or Data Ingestion Module

: PDS :

ESAMaintenance : QualityAnalysis&ReportGeneration

: MCS : ConfigurationData&DataSatellite : ResearchAndDevelopment

Modification configuration: satellite and instruments

Generate the data to be included in database based in product files

DPM or Data Presentation Module

Generate the Quality Report

Product file discovery

Distribute Quality Report

Distribute Quality Report

Configure a Use Case

Subscribe to a specific Quality Report

Subscribe to a specific Quality Report


Development Process (VI/VIII)Development Process (VI/VIII)

• Develop process: Develop process: Creation of a customized solution for providing new specific reports from the data extracted from the satellites.

• Inputs:Inputs: Description of the report content

• Outputs:Outputs: DIM, DPM and new configuration

• Actors: ·Actors: ·– DEIMOS– ESA Development– ESA Maintenance– Research and

Development


Quality platform (QUARC): Quality Process (VII/VIIIQuality platform (QUARC): Quality Process (VII/VIII))

• Quality Platform: Quality Platform: – QUARC in grid– Use Cases

• Generate and distribute report (DPM/DIM)

• Add subscription to a report

• Monitor System• Configure Use

Case• Control System

– Actors: ·• PDS• ESA Maintenance

– Administrator– Configurer

• Research and Development

• DEIMOS (Not included because it is not automatic)

Monitor system Configure Use Case

Administrator

Control system

Configurer

Client Report could be one of these two actors:

ESA Maintenance could be one of these two actors:

Researcher and Developer

Add subscription to a report

PDS

Generate and Distribute reports


Grid Use Cases: Development Process (VIII/VIIIGrid Use Cases: Development Process (VIII/VIII))

• GRID USE CASES:GRID USE CASES:

– Development process

– Developed elements:• DIM• DPM • Use Case configuration


Quality Platform: Problems (I/IV)Quality Platform: Problems (I/IV)

• Development CostDevelopment Cost– Ad-hoc development of DIM and DPM

• Unambiguous languageUnambiguous language– Complicate mapping from scientific language and technical language

• Reduction the data transferReduction the data transfer – Big product files– Lots of product files– Unused product files– Ad-hoc searching of files

• Reduction the processing time: On time quality reportsReduction the processing time: On time quality reports– Data transfer– Data storage in the database– Sequential DIMs and DPMs

• Fault ToleranceFault Tolerance– Unique equipment with the whole system

• Multiple access control Multiple access control – Replicate in system and in the resources machines


Quality Platform: OntoGrid Solutions (II/IV)Quality Platform: OntoGrid Solutions (II/IV)

• Development Cost Development Cost – Create semi-automatic development for DIMs and DPMs

• Reduction the data transferReduction the data transfer Big product files Lots of product files < Unused product files Ad-hoc searching of files: Dynamic Resource Discovery Increase the interconnection between equipments

• Reduction the processing time ??Reduction the processing time ?? Data transfer: Reduce the data processing due to reduce of data transfer. Data storage in the database Sequential DIMs and DPMs: Parallel several tasks < Increase the time of searching product file

• Decrease the time of searching due policy “incentive the success acquisition”

• Fault Tolerance Fault Tolerance – DIMs and DPMs could be started-up in any place.

• Multiple access control Multiple access control – Unify access control.


Quality Platform: Open Points (III/IV)Quality Platform: Open Points (III/IV)

• Scalability problem of computationScalability problem of computation

• Definition of generic and standard list of possible logics over the fields in Definition of generic and standard list of possible logics over the fields in different filesdifferent files

• Quality platform implementation depending on basic OntoGrid platformQuality platform implementation depending on basic OntoGrid platform


Quality Platform:Quality Platform: Architecture Architecture


ObjectiveObjective– Report presenting the correct working of an instrument in

the timeInputInput

– Some products from some instruments from Envisat

OutputOutput– EnviSat Instrument Availability Interruptions: A history of

the periods of unavailability for various instruments onboard EnviSat. This is presented in a table by instrument, unavailability start or unavailability end. An example of presentation is: Availability table

– Line in plotXY per each instrument and in the time

Use Case I: Interfaces (I/III)Use Case I: Interfaces (I/III)

http://envisat.esa.int/instruments/availability/


ExecutionExecution

– Retrieved some product files for some instruments using time filter. Optional retrieval, if a file is not available.

– Filtering the extracted files through some fields included in the product file: ACQUISITION_STATION, PROC_CENTER

– Mapping for language discrepancies: • PROC_CENTER (different name for the same elements), • PROC_TIME (different format time)

– Composition of each product data over the satellite change modes.

– Generate the output report

– Distribute the output report to the subscribers.

Use Case I: Execution (II/III)Use Case I: Execution (II/III)


ValidationValidation

– Configure the test case: Include the DPM, DIM and configure data (DPM, DIM, scheduler, workflow)

– Verify the selected files used as referenced.

– Check the report against the selected files using EnviView to visualize the referenced product files.

Use Case I: Validation (III/III)Use Case I: Validation (III/III)


ObjectiveObjective– Report presenting the correct working of an instrument in

the time. For this task, it is generated a report showing the list of periods with an adequate level of quality. In fact, the quality of an instrument is based in the quality of its product files.

• product quality is based in elimination policy for reducing the list of measures to the ones with adequate level of quality.

InputInput– Several product files from ASAR instrument.

OutputOutput– Line in plotXY per ASAR instrument and in the time. The

elimination policy will be displayed also.

Use Case II: Interfaces (I/III)Use Case II: Interfaces (I/III)


ExecutionExecution

– Retrieved some product files for ASAR instrument using time filter.

– Elimination Plan or policy• This elimination plan is done by instrument: one policy per each

product file type and the conjunction of all the policies. The elimination plan is based in condition with and annotation per each data record per file. In fact the condition per data record is built with conjunction of simple conditions. Hereafter a simple condition consists of field name (See table “Table 8 Fields for file type”) with an operator and a value. The operator could be <, >, = or !=. The value could be a number or a string.

– Generate the output report

– Distribute the output report to the subscribers.

Use Case II: Execution (II/III)Use Case II: Execution (II/III)


ValidationValidation

– Configure the test case: Include the DPM, DIM and configure data (DPM, DIM, scheduler, workflow)

– Verify the selected files used as referenced.

– Check the report against the selected files using EnviView to visualize the referenced product files.

Use Case II: Validation (III/III)Use Case II: Validation (III/III)


ConclusionsConclusions

DiscussionsDiscussions

Documents

DEIMOS – 17 January 2005 1 Ontogrid Presentation OntoGrid Business Case, User Requirements Analysis…