Embed Size (px)
DESCRIPTION
BIRN Data Grid. Roman Olschanowsky. University of California, San Diego February 17, 2004. Introduction. BIRN-CC’s purpose is to provide it’s consortium of neuroscience laboratories the ability to share, compute, and collaborate. - PowerPoint PPT Presentation
Citation preview
www.nbirn.net
University of California, San Diego
February 17, 2004
BIRN Data GridRoman Olschanowsky
Introduction
BIRN-CC’s purpose is to provide it’s consortium of neuroscience laboratories the ability to share, compute, and collaborate.
SRB provides the ability to transparently share data across remote sites.
Outline
Introduction to SRB– Discussion on SRB basics– SRB Clients
Overview of BIRN Data Grid– Infrastructure– Topology– A BIRN site– SRB Stability– SRB Statistics
Introduction to SRB
A distributed file system (Data Grid)– Client-server architecture.
– Abstracts physical
What we are familiar with
What we are not familiar with, yet
How do they differ?
Logical Abstraction– Folders are NOT physical– Files do NOT inherit physical location– Everything is potentially distributed
Access Control– Permissions are NOT rwxrwxrwx– Permissions ARE on a object by object basis– Groups and permissions ARE more similar to NTFS
Domains– Provides geographical / logical grouping of users– Provides namespace scalability: john@harvard john@mit– Also doubles as groups
mySRB
Common Scommands
Sinit Senv Spwd Sls -l Sget Sget (Sget –m –b) Sbunload Sput Sput (Sput –m –b) Sbload
Scp Smv (logical) Sphymove (physical) Srm Scd Smkdir Srmdir Serror Schmod
Don’t forget to Sexit!
BIRN Portal
Grid Computation
Globus– lddmm jobs: JHU utilizes both TeraGrid and BIRN for the
calculation of shape differences between normal and diseased brain structures. Producing terabytes of resultant data stored back into BIRN data grid.
SRB Proxy Operations– Image conversions and manipulations via ImageMagick
operations. (convert)– Analyze Volume Slice Extractor (anslex)– Data is not transferred, result of operation is streamed to
user.
The BIRN Data Grid
The BIRN Data Grid
The grid is in the details
File Replication
Sls/home/Demo/SRB-Tutorial/files-2: Doc.txt
Sls -l/home/Demo/SRB-Tutorial/files-2: romanoly 0 z-ucsd-ncmir-nas1 15 2003-07-09-05.15 Doc.txt romanoly 1 z-jhu-cis-nas0 15 2003-07-09-05.16 Doc.txt romanoly 2 z-stanford-lucas-nas 15 2003-07-09-05.16 Doc.txt romanoly 3 z-umn-cmrr-nas0 15 2003-07-09-05.16 Doc.txt romanoly 4 z-uci-bic-nas0 15 2003-07-09-05.17 Doc.txt
Components of SRB Space
DR
DR
MC
DR - Data RepositoryMC - Meta CatalogSC - SRB Client
SRB
SRB
SRB
SRB
SRB
SRB
SRB
SRB
SRB
SRB
SCSC
SC
SC
SC
DR
DR
DR
DR
DR
DR
DR
DR
Physical RackBIRN 1.0 Rack BIRN 1.5 Rack
Physical Rack Layout
DL380 NAS 0.5 to 2.0 TB
Cisco 4506
DL380 Grid POP
• Gigabit/10/100 Network Switch – Cisco 4506
• Cisco 3002 3DES Encrypted VPN for secure statistics and packet tracing
•Gigabit Ethernet Network Probe
• DL 380 NetTools Network Statistics System
• DL 380 General purpose compute platform
• DL 380 Grid POP
• SRB, Globus
• Dual Processor Linux with1GB memory
• Network Attached Storage – Gigabit Ethernet
• 0.5 TB to 2 TB
• UPS for Rack (208VAC/40Amp supply)
• Direct Power for redundancy (208VAC/30Amp)
GigE Net Probe
UPS
DL380 General
DL380 NetTools
Fiber Tap
LCD PopUp Screen/Keyboard
Cisco 3002
SRB “Location” or “Slave Server”
SRB
SRB
“Location”
“Physical Resources”
z-jhu-cis-nas0
“jhu-cis-nas”
DR
z-jhu-cis-nas1z-jhu-cis-nas2
Logical / Compound Resources
SRB
SRB“My-Resource”
“instant replication”
“fast archival”
“resource pooling”
Monitoring Grid Status
0.7 TB
5.2 TB
0 TB
1.6 TB
0.8 TB
0.8 TB
3.2 TB
0.8 TB
2.4 TB
0.8 TB
0.8 TB
2.4 TB
1.6 TB
0.8 TB
5.0 TB
0.78 TB
0.08 TB
Stability
BIRN Grid is up and available approximately 98%
Example of typical site uptime:
4.2 Million Files
6.6 Terabytes Used
Logical Resources
More Domains than Resources
Collaboration Reports
Collaboration Reports
Conclusion
SRB provides BIRN’s neuroscience laboratories with the ability to share and collaborate.
Questions?
www.nbirn.net
www.sdsc.edu/srb
