1
The Grid Workloads Archive Alexandru Iosup, Dick Epema (TUDelft) Catalin Dumitrescu (UChicago) Hui Li, Lex Wolters (ULeiden) Mathieu Jan (INRIA) Research in grid resource management: scheduling, monitoring, benchmarking, workload modeling, etc.; Grid maintenance and operation: daily functionality checks, long-term maintenance, realistic tests, stress tests, reliability tests, functionality tests, design adequacy tests etc.; Grid design, procurement, and performance evaluation: comparing grid settings, “what if?” scenarios, grid benchmarking. Community effort “ Easy access to grid workload traces. ” Timeline How to use the GWA? We have already received contributions from a number of grid owners and/or operators, which we gratefully acknowledge and thank. [email protected] http://gwa.ewi.tudelft.nl/ http://gwa.ewi.tudelft.nl/ The rid orkloads rch ive G W A Si n ce 2 0 0 6 2006 Mar Dec Mar 2007 Mar Dec 2010 GWA idea GWF draft GWA onlin e 10 traces online 20 traces online Why do we need grid traces? Standard data format (GWF) - Share traces with the community - Use extensions for specific modeling aspects - Text-based, easy to parse for custom tasks - Additional SQL-compatible data format (GWF-SQLite) Automated trace analysis - Provide ready-to-use tools to the community - Promote results availability and comparability Automated trace ranking - Help non-experts with their trace selection process We need We need your your help! help! Use GWA traces in Use GWA traces in your your work! work! We are looking for one-time contributors, that is, contributors who agree to share their old grid traces with the community, and, most importantly, for monthly contributors, that is, contributors who agree to send current trace data monthly. http:// gwa.ewi.tudelft.nl The Grid Workloads Archive (GWA) is at the same time a workload data (trace) repository and a community center for resource management and scheduling in grids. The GWA, a potential solution Understand how real grids are used Address the challenges facing grid resource management research and practice Develop and test grid resource management solutions Perform realistic simulations

The Grid Workloads Archive

Embed Size (px)

DESCRIPTION

Mar. Dec. Mar. Dec. Mar. 2006. 2007. 2010. 20 traces online. GWA idea. GWF draft. GWA online. 10 traces online. The Grid Workloads Archive. [email protected]. Alexandru Iosup, Dick Epema (TUDelft) Catalin Dumitrescu (UChicago) Hui Li, Lex Wolters (ULeiden) Mathieu Jan (INRIA). - PowerPoint PPT Presentation

Citation preview

Page 1: The Grid Workloads Archive

The Grid Workloads ArchiveAlexandru Iosup, Dick Epema (TUDelft) Catalin Dumitrescu (UChicago) Hui Li, Lex Wolters (ULeiden) Mathieu Jan (INRIA)

• Research in grid resource management: scheduling, monitoring, benchmarking, workload modeling, etc.;

• Grid maintenance and operation: daily functionality checks, long-term maintenance, realistic tests, stress tests, reliability tests, functionality tests, design adequacy tests etc.;

• Grid design, procurement, and performance evaluation: comparing grid settings, “what if?” scenarios, grid benchmarking.

Community effort

“ Easy access to grid workload traces. ”

Timeline

How to use the GWA?

We have already received contributions from a number of grid owners and/or operators, which we gratefully acknowledge and thank.

[email protected]

http://gwa.ewi.tudelft.nl/http://gwa.ewi.tudelft.nl/

The r id or kl oads r chiveG W A

Since 2006

2006Mar Dec Mar

2007MarDec

2010

GWAidea

GWFdraft

GWAonline

10 tracesonline

20 tracesonline

Why do we need grid traces?

• Standard data format (GWF) - Share traces with the community - Use extensions for specific modeling aspects - Text-based, easy to parse for custom tasks - Additional SQL-compatible data format (GWF-SQLite)

• Automated trace analysis - Provide ready-to-use tools to the community - Promote results availability and comparability

• Automated trace ranking - Help non-experts with their trace selection process

We need We need youryour help! help!

Use GWA traces in Use GWA traces in youryour work! work!

We are looking for one-time contributors, that is, contributors who agree to share their old grid traces with the community, and, most importantly, for monthly contributors, that is, contributors who agree to send current trace data monthly.

http://gwa.ewi.tudelft.nl

The Grid Workloads Archive (GWA) is at the same time a workload data (trace) repository and a community center for resource management and scheduling in grids.

The GWA, a potential solution

• Understand how real grids are used

• Address the challenges facing grid resource management research and practice

• Develop and test grid resource management solutions

• Perform realistic simulations