Upload
brittney-young
View
218
Download
2
Tags:
Embed Size (px)
Citation preview
CGSP and Vega in ChinaCGSP and Vega in China
Zhiwei XuInstitute of Computing Technology
Chinese Academy of [email protected]
OGSA-UK MeetingJanuary 31, 2005, London
National Grid Projects in China
Net-based Science Environment
Plan
Research
Develop
Construct Procure Deploy Operate Manage
E-Science Data Grid
Science and Technology R &D Assets Foundation Platform
Next-Generation Network Initiative
Edu. & Res. Grid
ChinaNational
Grid
StateCouncil
NSFC
CAS
MoE
MoST
NationalPlanningCommission
Semantic Grid
Digital China Grid (2006-2020)
ChinaGrid Structure
Campus Grids
大科防国
清华学大
大科华中 学大
山中 学大京北
大交海上
大交安西
学大北东
工理南华
航北
学大南东
学大 东山
Massive DataProcessing
CFD
DistanceEducation Bioinformatics
ImageProcessing
CGSP’s modules
Portal
Information Center
Uniform Management
Computing Nodes
Secu
rity Mod
ule
Grid Developing Environment
Portal:Grid entry for submitting & monitoring job, querying resources’ info, user management and accouting etc.
Grid Developing Environment: a set of toolkits including portal development tools, resource encapsulation tools, programming tools and job generation tools etc.
Information Center:the manager of resource & service information
Uniform Management:a set of managers including job manager, data center, domain manager and service container.
Security:Identity authentication and mapping, service and resource authorization, secure transferring etc.
GSI
WS-Security
CAS
SimpleCA
Data Managemen
tSecurity
WSCore
Resource Managemen
t
Information Services
Authz Framework
RFT
RLS
OGSI-DAI
New GridFTP
XIO
JAVAWS Core(WSRF)
C WS Core(WSRF)
MDS2
WS-Index
Pre-WSGRAM
WS-GRAM
CSF(contribution)
pyGlobus(contributed)
Python Bindings(contributed)
Data Center(CGSP)
Data Center(CGSP)
Portal SDK(CGSP)
Portal SDK(CGSP)
Programming Toolkits(CGSP)
Programming Toolkits(CGSP)
Resource-Index(CGSP)
Resource-Index(CGSP)
HyperService(CGSP)
HyperService(CGSP)
Proxy(CGSP)
Proxy(CGSP)
MetaData-Man(CGSP)
MetaData-Man(CGSP)
InterDomain(CGSP)
InterDomain(CGSP)
Topologic(CGSP)
Topologic(CGSP)
RemoteDeploy(CGSP)
RemoteDeploy(CGSP)
Job Manager(CGSP)
Job Manager(CGSP)
WorkFlow(CGSP)
WorkFlow(CGSP)
HotDeploy(CGSP)
HotDeploy(CGSP)
GT3.9 and CGSP
What Is Vega?• Grid related research thrust (brand) at ICT since 1999• Founded by MOST, CAS, NSFC, industry People
Grid system software (GOS) 40 Information Grid software (VIG) 10 Service Grid software (VINCA) 30 Basic research and semantic grid (Vega-KG) 30 Share common philosophy VEGA 110
– Versatile Services– Enabling Intelligence– Global Uniformity– Autonomous Control
• Vega Grid Inc. established in 2004• Software versions 2000 2003 2005
GOS (started in 1999) 0.5 1.0 2.0 VIG (started in 1999) 0.6 1.0 2.0 VINCA (started in 2002) 1.0 2.0
ResourcesGOS
VIGVINCA
Apps
Ad hoc GT3 WS-I
Vega Grid Software Suite
Distributed Resources and ServicesDistributed Resources and Services
Service GridVINCAInformation Grid
VIG
Vega System Software GOS
Vega Grid Targeted Users
• Universities
• Research institutes
• Manufacturing (Aviation, Space, Automobile)
• Weather, traffic, railways, supply chain
• Underground water, minerals, irrigation
• Petroleum
Vega Grid Software
Distributed Resources and Services
App Scope of Vega Grid Software
ScienceResearch
Manufacturing Resources and Environment
Services Sector
Vega Grid Architecture
GR
GSML PageClient
Effective
Virtual
Physical
Internet
GSML PageGSML Page
Grip1 Grip2 Grip3 Grip4
Grid Operating System ( GOS Kernel, Core, Libraries, Utilities)
Beijing Node
GSGR
Shanghai Node
GSGR
Xi’an Node
GS
Server PhysicalResource
GR Grid Router GS Grid Switch
Agora 1 Agora 2
MapperComposer
Composing Mapping
DawningDagger
EffectiveResource
VirtualResource
Vega GOS
Agora Service Engine
Java J2SE, J2EE/Microsoft Windows
GOS Hosting Environments
GOS Core Services
Service BUS
User Mgmt. EngineAgora
AccountVerification
Global UserAuthentication
Resource Mgmt. EngineService AddressTrans.
PT
Policy Engine
Resource Authority
Grip Engine
Grip Container
Grip Lifecycle Mgmt.
Core Libraries (Core API)
GOS System Services
File Services Database ServicesData BUS
Certificate/CA Mgmt.
System Mgmt. Services
Metadata Services
Information Integrator
Inforamtion BUS
TransformationStabilizer
Data Integrator
Computing Services
DDS
Batch Services
Legacy Resource
IntegratorMonitor
Logging Audit
Config
System Libraries (System API)
Portal Engine GSML Interpreter Abacus Compiler Workflow Engine
Grid PortalGSML
BrowserAbacus Studio
Vinca Workshop
Build-in Utilities
...
Tomcat(Apache)
WebSphere(IBM)
WebLogic(BEA)
.NET(Microsoft)
GT4(Globus)
User Def.Apps.
Service Router Service Registry Service Adapter
GOS Applications
ExtendedSystem
Services
Vega GOS and OGSA V1.0
• Vega is an implementation of (part of) OGSA• Vega would like to contribute to OGSA
After implementation and testing (running codes) Loose coupling Partner with other groups Focus on 4 key issues and aim at minimal common requirements
• Naming, Process/States, VO, Programming
• Vega complements existing grid projects Focus on implementation architecture, not protocols/services
• Use computer systems approach, not middleware or network Utilize existing software
• At Vega GOS kernel level– Apache; OMII, GT4; Commercial
• As services• At Vega GOS application level
Security in Vega GOS• End-to-End
From user log-on to physical resource execution Details are hidden from user/developer
• Based on WS-Security Cert based authentication; Token based authorization & AC; signature
Web uCert
Portal/Server
uid/pass
Grip Container
Agora pCertpCertpCert
Phy Svc Phy SVC Phy SVC Phy SVC
pCertuTK
pCertuTK
pCertuTK
pCertuTK
User Res AA
uTKuTKuTK
Other Client
pCert
uCert
Naming in OGSA and Vega GOS
• Vega matches OGSA 3-level naming convention OGSA Human-Oriented Abstract
Address Vega (EVP) Effective Virtual Physical
• OGSA Naming specification must include Precise definitions and axioms Syntax and semantics (rough consensus)
• Who provides, uses, and maintains such names• Scoping and name/address space• Full Lifecycle• Mapping, resolution, binding• Exception handling• Provision for resources
VO in OGSA and Vega GOS
• There is no precise definition of VO in OGSA
• Agora is a concrete example of VO (community)
• Agora has a precise definition, and it holds Subjects, objects, context/policies information Agora-related system services
• Agora is persistent and “static”
• Application programmer knows the agora concept, but agora does not appear in app codes
Process/States in OGSA and Vega GOS
• There is no process concept in OGSA 1.0• Grip is distributed process in grids environment
A runtime construct representing a subject (a grid user running a grid application) to access and utilize objects (grid resources and services)
• Classification of “states” Session related Application logic specific Grid system related Resource related Service specific
Grip
Core and Kernel
Put It Together
Web
GripUser, App Logic
Address Space, States
AgoraPolicies:
Security and Selection
Phy Svc Phy SVC Phy SVC Phy SVC
Other Client
System ServicesResource Services
UI and Utility Tools
Common Supports
not per-service or per-application codes120 KLOC
Follow the E2E and KISS principles Loose coupling; Hide details, reduce coding; Try to minimize abstractions
4 abstractions: User, (Effective) Service, Grip, Agora5 API “functions”
Vega GOS Roadmap in 2005
• 2004.11 2.0 preview Sample Apps
• 2005.2 2.0 alpha
• 2005.4 2.0 beta CNGrid Apps
• 2005.6 2.0 CNGrid Deploy
• 2005.7 2.0 on OMII Other Apps
• 2005.11.30-12.3 CI6016 & GCC 2005 Exhibit www.ict.ac.cn/ci6016
GOS mail-list : [email protected]
CNGrid : http://www.grid.org.cn/
Vega GOS : http://vega.ict.ac.cn/
Summary
• Grid activities in China are still growing• CGSP started development in 2004
extends WSRF (GT 3.9), will release V1.0 this year
• Vega started in 1999 China apps driven, while learning from international community Will release V2.0 in June 2005 Based on WS-I and uses a computer systems approach
• Vega and OGSA Partner with OGSA-UK
• Use OMII as a kernel and system services• Naming (EVP), Grip, and Agora