Performance Study: Abaqus/Standard 6.8-3Slide 11Slide 11 Please Keep Confidential to Customer and...

Performance Study:Abaqus/Standard 6.8-3

Stan PoseyDirector, Industry and Applications Market DevelopmentPanasas, Fremont, CA, USA

Bill Loewe, Ph.D.Sr. Applications EngineerPanasas, Fremont, CA, USA

Please Keep Confidential Between CSC and PanasasSlide 2 Please Keep Confidential to Customer and Panasas

Background on Abaqus/Standard Study

Abaqus is an application from SIMULIA -- not a benchmark kernel

The FEA model and tests are relevant to customer practice

All tests were run on a dedicated system at Panasas

The results were validated by SIMULIA

Since Apr 2007, SIMULIA and Panasas have made joint

investments in a business and technical alliance that

ensures Abaqus will fully leverage Panasas PanFS

This study demonstrates benefits of Panasas parallel file

system and parallel storage for Abaqus/Standard 6.8-3

with tests for both single job and mulit-job computing

Motivation

Considerations

Abaqus/Standard 6.8-3: Model S4b 5M DOF Non-linear Static Analysis

Automotive engine block cylinder head bolt-up

Panasas Study on Abaqus/Standard 6.8-3

Abaqus/Standard I/O Scheme

CSM implicit solver

Abaqus/Standard is

direct and single-

step, with out-of-core

READS and WRITES

-- I/O occurs in the sparse

factor phase of the solver

-- this scheme is for static, if

an eigen (Lanzcos) solution,

then I/O can be VERY heavy

-- NOTE: Abaqus also has an

implicit iterative solver

Write solution results [100’s of GB’s of I/O]

complete

element matrix

generation and

assembly into

global matrix

matrix factor

(dominant phase,

as much as 85%

of total time,

often I/O wait)

FBS solve phase,

stress recovery,

multiple RHS’s

Factor matrixout-of-core,reads/writes

Read nodes,elements andcontrol file

Work Dir: serial IO

Scratch Dir: parallel IO

Work Dir: serial IO

Job Task IO Scheme IO Operation

Features of the Hardware System Configurations

CISCOSYSTEMS

NOTE: Panasas total 30 TB in 12U, installed and operational in just 1 hr!

10 GigE

Features of Penguin cluster configuration:

Processors: 2.3GHz QC AMD Opteron

Nodes: 8 x 2 Sockets x 4 cores; 2 GB/core

Interconnect: 10GigE

Local FS: Ext3, single drive per node, 160 GB

SATA, 7200 RPM

Features of the Panasas storage system:

3 shelves: 1 director + 10 storage blades

Each shelf 10 TB, total of 30 TB

Panasas Study on Abaqus/Standard 6.8-3

8 nodes,

64 cores

Abaqus/Standard 6.8-3: Comparison of PanFS vs. Local FS

Total Time in Seconds

5M DOFEngine Block

1273213674

PanFS -- Num OpsPanFS -- Total TimeLocal FS -- Num OpsLocal FS -- Total Time

better

NOTE: Num-Ops times within 1%Difference is IO

NOTE: PanFS

11% Advantage

in Total Time

vs. Local FS

S4b Performance for Single Core

1 Job x 1 Core x 1 Node

Times for Single Job on a Single Core

Numerical vs. IO Computational Profile

18000Local FS -- IO-OpsLocal FS -- Num-OpsPanFS -- IO-OpsPanFS -- Num-Ops

Job Profiles of Numerical Ops % vs. IO %

better

13674 IO – 16%

Numerical

Operations

IO – 7%

NOTE: PanFS

11% Advantage

in Total Time

vs. Local FS

5M DOFEngine Block

Numerical

Operations

1 Job x 1 Core x 1 Node

S4b Performance for 1 Core x 8 NodesTotal Time in Seconds

5M DOFEngine Block

PanFS -- Num OpsPanFS -- Total TimeLocal FS -- Num OpsLocal FS -- Total Time

better

NOTE: PanFS

5% Advantage

in Total Time

vs. Local FS

Average Times of 8 Simultaneous Jobs

NOTE: N-Ops times within 1%Difference is IO

Average of 8 Jobs | Each on 1 Core | Each on 1 Node | 7 Cores Idle on Each Node

8 Jobs x 1 Core x 8 Nodes

Numerical vs. IO Computational Profile

18000Local FS -- IO-OpsLocal FS -- Num-OpsPanFS -- IO-OpsPanFS -- Num-Ops

Job Profiles of Numerical Ops % vs. IO %

better

14373IO – 19%

Numerical

Operations

IO – 12%

5M DOFEngine Block

Numerical

Operations

NOTE: PanFS

5% Advantage

in Total Time

vs. Local FS

Average of 8 Jobs | Each on 1 Core | Each on 1 Node | 7 Cores Idle on Each Node

8 Jobs x 1 Core x 8 Nodes

S4b Performance for 8 Cores x 1 NodeTotal Time in Seconds

5M DOFEngine Block

6000PanFS -- Total Time

Local FS -- Total Time

better

NOTE: PanFS

46% Advantage

in Total Time

vs. Local FS

Singe Job on Single 8-Core Node

1 Job x 8 Cores x 1 Node

S4b Performance for Single Job ScalingTotal Time in Seconds

5M DOFEngine Block

better

Scalability of Single Job from 1 to 8 Cores

1 Core

8 Cores

NOTE: PanFS

58% in Parallel

Efficiency vs.

35% for Local FS

1 Core

8 Cores

4.6x on 8

2.8x on 8

S4b Performance for 8 Cores x 4 NodesTotal Time in Seconds

5M DOFEngine Block3773

6000PanFS -- Total Time

Local FS -- Total Time

better

NOTE: PanFS

40% Advantage

in Total Time

vs. Local FS

Average Times of 4 Simultaneous Jobs

Average of 4 Jobs | Each Job on 8 Cores | Each Job on 1 Node Using All 8 Cores

4 Jobs x 8 Cores x 4 Nodes

S4b Performance for Single vs. Multi-JobTotal Time in Seconds

5M DOFEngine Block

52895495

PanFS -- Total Time, Single Job

PanFS -- Total Time, Multi-Job

Local FS -- Total Time, Single Job

Local FS - Total Time, Multi-JobLower

better

Times of Single 8-way and Multi 8-way Jobs

4 Jobs

NOTE: PanFSdegrades 22%for1 to 4 nodes

NOTE: Local FSabout the same for 1 to 4 nodes, each FS on node is independent

NOTE: PanFS

40% Advantage

in Total Time

vs. Local FS

Panasas and Intel Abaqus S4b Study

Panasas:

16 client iozone

1180 MB/s write

1260 MB/s read

ENDEAVOR File Systems and Storage

PanFS: 2 Shelves AS6000 (1+10 and 2+9), 38 TB FS; network connected through 10GigE switches and IB router, ~ 1.2 GB/s

Lustre: DDN storage, 100 TB FS, ~ 5 GB/s

Local FS: Ext2 FS, 370 GB SATA drive, 80 MB/s per disk

Intel ENDEAVOR Xeon ClusterLocation: Intel HPC Customer Enabling Center, Dupont ,WA

Vendor: Intel; 80 nodes; 640 c ores; 18 GB memory per node

CPU: Intel Xeon (Nehalem) QC, 2.8 GHz, 8 cores per node

Interconnect: Infiniband

File Systems: Panasas PanFS; Lustre on DDN; Local disk

Operating System: RHEL Linux v5.2

Local FS:

~80 MB/s

per disk

DDN/Lustre:

16 client iozone

5390 MB/s write

3370 MB/s read

ENDEAVOR

639 574

8 16 32

Local FS

Abaqus/Standard 6.8-3: Comparison of PanFS vs. Local FS Ext2

5M DOFEngine Block

better

Single Job Scalability 8 to 32 Cores; Memory 90%

NOTE: PanFS

advantage over

Local for single

node case when

IO is heavy – in

the same range

for 2-4 nodes

when job goes

in-memoryNumber of Cores

1268 1219 12191289

Memory 90% Memory 70%

Local FS

5M DOFEngine Block

better

Single Job Scalability on 16 Cores; Memory 90%/70%

NOTE: Effect of

memory setting

16 Cores Each Case

12941360

2000PanFS

Local FS

S4b Performance for Multi-Job Thru-putTotal Time in Seconds

5M DOFEngine Block

better

Average Times for 8 Jobs, Each 16 Cores; Mem 90%

NOTE: PanFS

and Local FS

difference ~ 5%

Average Times for 8 Jobs | Each Job on 2 Nodes | Each Job on 16 Cores | Total 128 Cores

8 Jobs x 16 Nodes x 128 Cores

Average of 8 Jobs Average of 8 Jobs

Questions

Thank You

For more information,call Panasas at:

1-888-PANASAS(US & Canada)

00 (800) PANASAS2(UK & France)

00 (800) 787-702(Italy)

+001 (510) 608-7790(All Other Countries)

Performance Study: Abaqus/Standard 6.8-3Slide 11Slide 11 Please Keep Confidential to Customer and...

Documents

Introduction to Abaqus Scripting - 4RealSim · Introduction to Abaqus Scripting ... Organize and present the technical details of Python and the Abaqus Scripting ... Abaqus Namespaces

Google Confidential and ProprietaryGoa Haul Destinations Rank Queries Yoy Relative Size 42.4 28.6 26.3 25.0 21.3 19.2 18.0 17.4 16.4 16.0 12.9 10.0 10.0 8.7 8.0 7.9 6.8 6.8 6.5 0 +2

Abaqus Behavior

Abaqus Python

ABAQUS Data Sheet2 - beasy.com ABAQUS... · 1 PRODUCT DATA SHEET ABAQUS Interface BEASY ABAQUS provides an integrated approach between BEASY and ABAQUS for stress, fracture …

Abaqus Keywords

Introduction to Abaqus/CAE - · PDF fileDay 1 Lesson 1 Introducing Abaqus/CAE Demo 1 A First Look at Abaqus Workshop 1 Overview of Abaqus/CAE Lesson 2 Working with Geometry in Abaqus/CAE

abaqus fem

Simulia Abaqus

Durability and Damage Tolerance Evaluation of VaRTM Wing ... 10/10-3... · Preliminarily analysis FEM d ABAQUS V 6 8 G i l li i id dFEM code: ABAQUS Ver. 6.8, Geometrical nonlinearity

Rapport Abaqus

Turtorial Abaqus

Abaqus Steps

ASEE Introduction to Abaqus Workshopasee.engin.umich.edu/.../02/Abaqus-Presentation-Slides-from-Worksh… · ASEE Introduction to Abaqus Workshop What to do to get started Open Abaqus

ABAQUS for Engineering · Computational Science and Engineering CSE.ILLINOIS.EDU ABAQUS Materials Primary References Abaqus/CAE User’s Manual, §12.7–11 Getting Started with Abaqus:

User Abaqus

Immunonologie en analyses médicales · QC SAC %cv Direct %cv low 2.2 7.4 low 2.0 8.2 med 1.7 6.8 med 1.9 7.2 high 1.8 6.4 high 1.8 6.8 . Business confidential. For internal use only

Introduction to Abaqus Scripting - Caelynx · Introduction to Abaqus Scripting Abaqus 2018 . Course objectives Help students to develop a high level understanding of the Abaqus scripting

Automotive NVH with Abaqus - · PDF fileAutomotive NVH with Abaqus ... Analysis Procedures Element Size ... Overview of Abaqus/CAE Starting Abaqus/CAE Orphan Mesh Import

Composite Abaqus