23
INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org SCAS Progress Oscar Koeroo

SCAS Progress

  • Upload
    ria-le

  • View
    34

  • Download
    3

Embed Size (px)

DESCRIPTION

SCAS Progress. Oscar Koeroo. index. The architecture The paper work The implementation. The architecture. Our current architecture. Worker node. Glite: Compute Element or Storage Element. glexec. glexec. pre-WS GT4 gk, gridftp, opensshd. LCAS + LCMAPS. edg-gk. L&L plug-ins - PowerPoint PPT Presentation

Citation preview

Page 1: SCAS Progress

INFSO-RI-031688

Enabling Grids for E-sciencE

www.eu-egee.org

SCAS Progress

Oscar Koeroo

Page 2: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 2

Enabling Grids for E-sciencE

INFSO-RI-031688

index

• The architecture

• The paper work

• The implementation

Page 3: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 3

Enabling Grids for E-sciencE

INFSO-RI-031688

The architecture

Page 4: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 4

Enabling Grids for E-sciencE

INFSO-RI-031688

L&L plug-ins

(regular set of plug-ins)

L&L plug-ins

(regular set of plug-ins + GPbox)

Our current architecture

LCAS + LCMAPS

Glite: Compute Element or

Storage Element

edg-gk

glexec

edg-gridftp gt4-interface

pre-WS GT4 gk, gridftp,

opensshd

LCAS + LCMAPS

Worker node

glexec

L&L plug-ins

(regular set of plug-ins)

Issues with this setup:• share/distribute the gridmapdir for mapping consistency• share/distribute the configurations for the nodes• share/distribute authorization files, like grid/groupmapfiles and a blacklisting file• Scaling issues; lots of node will probably overload an NFS server

GPbox infrastructure

[xacml]

Page 5: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 5

Enabling Grids for E-sciencE

INFSO-RI-031688

pre-WS GT4 gk,gridftp, opensshd

The (old) big picture

SAML-XACML Query

OSG EGEE

glexecedg-gk

edg-gridftpd

gt4-interface

pre-WS GT4 gk, gridftp, opensshd

dCache

Common SAML XACML library

L&L plug-in: SAML-XACML

Prima + gPlazma:

SAML-XACML

LCAS + LCMAPS

CREAMPilot job on Worker Node

(both EGEE and OSG)

Site Central: LCAS + LCMAPS

L&L plug-ins (regu. set)

Site Central: GUMS (+ SAZ)

SAML-XACML interface

Common SAML XACML library

Front-end node (CE, SE, WN, etc.)

gJAF / Globus AuthZ

Page 6: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 6

Enabling Grids for E-sciencE

INFSO-RI-031688

How it should work (conceptual)

SAML-XACML interface

Globus SAML XACML library

Site Central LCAS + LCMAPS or GUMS and SAZ

SAML-XACML PEP (L&L plug-in or PRIMA)

Globus SAML XACML library

Set of ObligationsObligation handler[N]Obligation handler[N]Obligation handler[N]

<Register set of oblig. IDs + define oblig. Handlers>

<work with PEP environment>

SAML-XACML Query

Q: map.user.to.some.poolOblg: user001, somegrpR:

1

2

3

4

56

Page 7: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 7

Enabling Grids for E-sciencE

INFSO-RI-031688

The paper work

Page 8: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 8

Enabling Grids for E-sciencE

INFSO-RI-031688

The AuthZ workgroup

• The group members:– OSG: Igor Sfiligoi, Gabriele Garzoglio, Ted Hesselroth, Jay

Packard, John Hover, Mine Altunay, Valery Sergeev, John Weigand, Keith Chadwick, Tanya Levshina

– EGEE: Oscar Koeroo, Yuri Demchenko, Håkon Sagehaug– EGEE / INFN: Alberto Forti, Andrea Ferraro, Vincenzo Ciaschini,

Valerio Venturi– Globus: Rachana Ananthakrishnan, Frank Siebenlist, Joe Bester

• Will include the Condor team in the near future– Discussions underway to support their requirements– Condor contacts:

Ian Alderman, Zackery Miller

Page 9: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 9

Enabling Grids for E-sciencE

INFSO-RI-031688

Main discussion points

• PEP & PDP interaction– Different types of PEPs will need to interact with the PDP

(SCAS) Gatekeeper: PRIMA or LCMAPS backend GridFTPd: PRIMA or LCMAPS backend Glexec-on-{CE|WN} dCache …

– The information that is contained in the request and response– Regardless of where the application that implements the PEP is

created– How to get the required authorization information from the PEP

• Upgradeability– Changes in the attribute (datatype, value form., name(space))– Changes in the obligations, regarded as a set of attributes

Page 10: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 10

Enabling Grids for E-sciencE

INFSO-RI-031688

The docs

• The documents in work– “XACML-SAML profile” (done)

Profiles the use of XACML and SAML

– “An XACML Attribute and Obligation Profile for AuthZ Interoperability in Grids” (reaching v1.0) Profiles the use of the attributes and obligations in the XACML

request & response protocol

Page 11: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 11

Enabling Grids for E-sciencE

INFSO-RI-031688

Request: Subject

– Subject-id: X.509 DN (OpenSSL oneline notation)– Subject-issuer: X.509 Issuer DN (OpenSSL oneline notation)– Subject-Certificate-Serial-Number– Subject-vo– VOMS-signing-subject: X.509 DN (OpenSSL oneline notation)– VOMS-signing-issuer: X.509 DN (OpenSSL oneline notation)– VOMS-dns-port– VOMS-FQAN– VOMS-Primary-FQAN– Subject End-entity X509v3 Certificate Policies OIDs– CA serial number– Certificate chain (experimental)

Page 12: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 12

Enabling Grids for E-sciencE

INFSO-RI-031688

Request: Action

– Run Job Queued: “queue” Particularly via a CE to a Batch system

– Run Job Now: “execute-now” On a CE; that’s the fork invokation On a WN; direct execution

– Access file: “access” No granularity in (specific) file permission (like read/write)

Page 13: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 13

Enabling Grids for E-sciencE

INFSO-RI-031688

Request: Resource

– CE: Computing Element resource type– WN: Worker Node resource type– SE: Storage Element resource type– Host DNS name

Page 14: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 14

Enabling Grids for E-sciencE

INFSO-RI-031688

Request: Environment

– Supported obligations1. Handling of returned obligations is mandatory at the PEP

2. The supported obligations are send to the PDP as advisory information to avoid returning useless obligations see previous statement

– Pilot job invoker identity This means all Subject attributes of the pilot job identity Policy statement example:

• “The VO of the pilot job invoker and real user job MUST be the same”

Page 15: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 15

Enabling Grids for E-sciencE

INFSO-RI-031688

Response: Obligations (0)

• UIDGID UID (integer): Unix User ID local to the PEP GID (integer): Unix Group ID local to the PEP

– Must be consistent with: Username (if receiving both)• Username

Username (string): Unix username or account name local to the PEP.

– Must be consistent with: Username (if receiving both)• SecondaryGIDs

– Multi recurrence GID (integer): Unix Group ID local to the PEP

• AFSToken AFSToken (string) in base64: AFS Token passed as a string

Page 16: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 16

Enabling Grids for E-sciencE

INFSO-RI-031688

Response: Obligations (1)

• RootAndHomePaths RootPath (string): this parameter defines a sub-tree of the whole file

system available at the PEP. The PEP should mount this sub-tree as the “root” mount point (‘/’) of the execution environment. This is an absolute path.

HomePath (string): this parameter defines the path to home areas of the user accessing the PEP. This is a path relative to RootPath.

– Needs obligation(s): UIDGID or Username

• StorageAccessPriority Priority (integer): an integer number that defines the priority to

access storage resources.

– Needs obligation(s): UIDGID or Username

Page 17: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 17

Enabling Grids for E-sciencE

INFSO-RI-031688

Open to discussion

• Explicit declaration of an multi-user pilot job scenario?• Were do we send the RSL string?

– Action?– Environment?

• Requirements from the Condor team?– Condor’s canonical name: <useraccount>@some.site– Problem with the subject-id being used for the X.509 subject DN

Page 18: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 18

Enabling Grids for E-sciencE

INFSO-RI-031688

The implementation

Page 19: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 19

Enabling Grids for E-sciencE

INFSO-RI-031688

It works!

• Localhost (low latency, but having the laptop hardware as a bottleneck)– Optimum rate (with SSL) was:

Nominal: 7Hz Burst: 20Hz Interval between bursts: 12 seconds

Page 20: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 20

Enabling Grids for E-sciencE

INFSO-RI-031688

New components in CVS & Etics

• org.glite.security.saml2-xacml2-c-lib-R_0_0_2_1– This is version alpha-0.0.7 from Globus– Contains:

the gSOAP stuff SAML2-XACML2 schema Helper functions Optional overriding of network layer Pushes registered obligations in the Environment of the Request

• org.glite.security.lcmaps-plugins-scas-client-HEAD– Depends on saml2-xacml2-c-lib– Implements the client code for the protocol

Uses the network layer overriding to implement SSL/TLS

– Implements the handlers for the supported obligations

Page 21: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 21

Enabling Grids for E-sciencE

INFSO-RI-031688

Todo

• Tying the loose ends together– The LCMAPS plugin is kinda ready

Integrated test: gLExec will be used to stress test the framework

– The prototype SCAS service should be ready any day Expecting first CVS checking of it next week, if all works as

promised Expecting pretty nice performance

• Simple tests showed to exceed the CERN requirement

– Name spaces for the attributes and identifiers in all sections Having a discussion now about this topic to include OGF in the

process We’ll use ‘something’ in the meanwhile

Page 22: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 22

Enabling Grids for E-sciencE

INFSO-RI-031688

?

Page 23: SCAS Progress

SCAS Progress, JRA1-AH Amsterdam 22 Feb 2008 23

Enabling Grids for E-sciencE

INFSO-RI-031688

The implementation