Upload
lamphuc
View
214
Download
0
Embed Size (px)
Citation preview
Applica'ons for a Seman'c CineGrid Exchange.
Ralph Koning Zhiming Zhao
Adianto Wibisono Paola Grosso Cees de Laat
13-‐12-‐2010 1 University of Amsterdam, System and Network
Engineering Research Group
CineGrid Descrip'on Language
• Uses RDF and OWL • Resource Descrip'on Framework, Web Ontology Language • Distributed, each node has its own descrip'on. • Reusable.
• Allows us to describe elements in the exchange and the services they provide.
• Node, Exchange, Device • Link with NDL to describe the underlying network infrastructure.
• Using owl:sameAs property.
13-‐12-‐2010 2 University of Amsterdam, System and Network
Engineering Research Group
Descrip'on example
13-‐12-‐2010 5 University of Amsterdam, System and Network
Engineering Research Group
Progress since CineGrid 09
• Extending CDL – Renaming of objects – FGCS: “Using ontologies for resource descrip'on in the CineGrid Exchange”
• Movie Metadata – Not aware of the probably ongoing discussion within CineGrid
– We use a very limited ontology just to make it work. • We need to make applica'ons aware of CDL the content requirements – NeWQoSPlanner – NDL/CDL ontology Editor
13-‐12-‐2010 6 University of Amsterdam, System and Network
Engineering Research Group
CineGrid specific workflows
• Show Content • Read data from storage • Stream data on network • Visualize recieved data
• Store Content • Get data from user • Put data on storage
• Process Content • Get file from storage • Do some processing • Put result on storage
13-‐12-‐2010 7 University of Amsterdam, System and Network
Engineering Research Group
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 8 University of Amsterdam, System and Network
Engineering Research Group
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
1
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 9 University of Amsterdam, System and Network
Engineering Research Group
The QoSWP receives the request for data process services and the service requirements from the user
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
1
2
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 10 University of Amsterdam, System and Network
Engineering Research Group
The RDA reads the descrip'on of the resources and the network topologies from the registry, and searches suitable data sources and des'na'ons, and network paths between them.
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
1
2
3
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 11 University of Amsterdam, System and Network
Engineering Research Group
The RDA returns a list of qualified candidates, and sorts them based on the quality metrics of each candidate.
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
1
2
3
4
5
4
5
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 12 University of Amsterdam, System and Network
Engineering Research Group
From the candidates, the QoSWP selects the best one, and request WCA and RPP to generate a resource provisioning plan and a data transfer workflow.
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
1
2
3
4
5
6
4
5
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 13 University of Amsterdam, System and Network
Engineering Research Group
The resource provisioning plan and a data transfer will be executed by the workflow engine.
Provisioning plan
Selected candidate
Resource Discovery Agent (RDA)
QoS aware Workflow Planner (QoSWP)
Workflow engine
Workflow Composer Agent (WCA)
User request
Network resource descrip'ons
Resource Provision Planner (RPP)
Provision plan
Data delivery workflow
requirements
Resource candidates
Mul:
agent system for Q
oS aware w
orkflow
managem
ent
QoS Monitoring Agent (QMA)
Provenance Service Agent (PSA)
Resources
1
2
3
4
5
6
4
5
7 7
NEtwork awareWorkflow QoS Planner (NEWQoSPlanner)
13-‐12-‐2010 14 University of Amsterdam, System and Network
Engineering Research Group
The QMA monitors the state of the resources and checks whether the required quality is sa'sfied.
Based on the state updates by QMA, the QoSWP may adapt the resources.
The provenance service records events in the resources provisioning.
QoS abstract workflow process descrip'on schema
13-‐12-‐2010 15 University of Amsterdam, System and Network
Engineering Research Group
Ontology mapping
13-‐12-‐2010 16 University of Amsterdam, System and Network
Engineering Research Group
Retrieving Informa'on
• hgp://cinegrid.uvalight.nl/owlportal
13-‐12-‐2010 17 University of Amsterdam, System and Network
Engineering Research Group
Use case: QoS guaranteed media delivery on demand
• Media delivery on demand – Search movie – Propose network path – Playback the movie
• Portal + search engine
13-‐12-‐2010 18 University of Amsterdam, System and Network
Engineering Research Group
NEWQoSPlanner References
• Z.Zhao et al. ,An agent based planner for including network QoS in scien'fic workflows, ABC:MI Oct.18~20, 2010, Wisla, Poland. – hgp://ext.delaat.net/posters/2010-‐10-‐14-‐QoSPlanner.pdf
• Z.Zhao et al. ,Network resource selec'on for data transfer processes in scien'fic workflow, WORKS, Super Compu'ng 2010, USA. – hgp://ext.delaat.net/posters/2010-‐11-‐12-‐SC-‐QOS.pdf
• hgp://cinegrid.uvalight.nl/owl/qosawf.owl
• hgp://cinegrid.uvalight.nl/owlportal
13-‐12-‐2010 19 University of Amsterdam, System and Network
Engineering Research Group
SNE CDL Editor
• Why do we need an editor? – Wri'ng CDL/NDL files by hand requires ‘some’ programming background.
– Sonware like ‘Protege’ makes the Job easier but s'll requires a technical background.
– Automated tools help but in most cases manual edi'ng is s'll required.
13-‐12-‐2010 20 University of Amsterdam, System and Network
Engineering Research Group
CDL Editor (Goals)
• Allows instan'a'on of concepts defined in CDL and NDL – User can create instances of classes – User can describe data proper'es of instances – User can describe object proper'es rela'ons – User can not modify classes defini'on (use Protege)
• Assumes no prior knowledge about OWL/RDF
• Provides graphs visualiza'on of what they had created.
• Extensible, can be used for other ontologies
13-‐12-‐2010 21 University of Amsterdam, System and Network
Engineering Research Group
Future work
• Further improve CDL – Specify network interfaces for services.
• Support for other workflows – Adding new content – Process content
• Create a easy to use query language to search content/nodes/resources.
13-‐12-‐2010 24 University of Amsterdam, System and Network
Engineering Research Group
Thank you!
• Portal – hgp://cinegrid.uvalight.nl/portal – hgp://cinegrid.uvalight.nl/owlportal/
• CDL Editor demo – http://sneneteditor.appspot.com
• Contact Info – [email protected] – hgp://staff.science.uva.nl/~ralph
13-‐12-‐2010 25 University of Amsterdam, System and Network
Engineering Research Group