Test Harness & WebsiteMike Phenow

Trilinos User Group MeetingNovember 4th, 2004 - 9:30 am

Contents• Test harness

– Overview– Design– Nightly– Local– Future

• Website– Trilinos– Developer– Package

• Questions

Test Harness ~ Overview• Current test-harness.plx grew out of Jim Willenbring’s

test-harness, which evolved from his earlier trilinos-check, which is based on Paul Lin's salsa-check, which was adapted from Gary Hennigan's Salsa-Check.sh

• Provides a standard framework for running tests (particularly for developers)

• Enables reasonable automation

• http://software.sandia.gov/trilinos/developer/test_harness.html• Trilinos/testharness/README• % perl test-harness.plx -h

Test Harness ~ Overview

Most important flags:

- Currently provides no testing functionality- For successfully built packages, will run any executable

test scripts in:Trilinos/packages/PACKAGE/tests/scripts/(daily|weekly)/(mpi|serial)/

-f FILE run with given config file-g FILE generate a default config file named FILE

-h print help

Test Harness ~ Design

configure

invoke-configure

build

test

report

starttest harness config

invoke-configure element

invoke-configure element

invoke-configure elementfix

fix

create

Test Harness ~ Designdependencies:amesos = \--enable-amesos \--with-ml_amesos

anasazi = \--enable-anasazi \--with-loca-anasazi

aztecoo = \--enable-aztecoo \--enable-komplex \--enable-ml_aztecoo \...

potentially-brokenpackage

configure optionsto be removed,

if broken

Anatomy of an invoke-configure:

Test Harness ~ Design

elements-machine/MACHINE_CONFIG_FILE

+ elements-trilinos/TRILINOS_CONFIG_FILE

Trilinos/SERIAL_DIR/invoke-configure

elements-machine/MACHINE_CONFIG_FILEelements-machine/MACHINE_MPI_CONFIG_FILE

+ elements-trilinos/TRILINOS_CONFIG_FILE

Trilinos/MPI_DIR/invoke-configure

• Most important config-file options– MACHINE_CONFIG_FILE– MACHINE_MPI_CONFIG_FILE– TRILINOS_CONFIG_FILE

– REPORT_METHOD• SEND_TO_DEFAULTS

– SERIAL_DIR– MPI_DIR

• HOST_FILE• MPI_STARTUP_CMD• MPI_SHUTDOWN_CMD• MPIGO_CMD

Test Harness ~ Design

Test Harness ~ Nightly• Platforms:

– Linux: herouxsmp.cs.csbsju.edu– Linux: software.sandia.gov– SunOS: paunchy.sandia.gov– Dec/OSF1: stratus.sandia.gov

• Changing configure options:– Trilinos/test-harness/elements-trilinos/– Trilinos/test-harness/elements-machine/– e.g. osf-stratus

Test Harness ~ Localhttp://software.sandia.gov/trilinos/developer/test_harness.html

create elements-machine/MY_MACHINEcreate elements-machine/MY_MACHINE_MPIcreate elements-trilinos/MY_OPTIONS

perl test-harness.plx –g config/MY_CONFIGedit config/MY_CONFIGperl test-harness.plx –p config/MY_CONFIG

perl test-harness.plx –f config/MY_CONFIG

Test Harness ~ Future

test machine

test machine

database

test machine test machine

test machine

test machine

Major Platforms Developer Machines

results results

queries results

browser

developer

queries results

Website ~ Trilinos• http://software.sandia.gov/trilinos• First stop for many users• Central location for information• Needs to be continually re-evaluated

Website ~ Developer• http://software.sandia.gov/trilinos/developer• Source for developer information and tools• Potential for more knowledge-sharing

Website ~ Package• http://software.sandia.gov/trilinos/packages• Natural place for posting critical information for users

• Doxygen documentation:– Trilinos/packages/PACKAGE/DoxyfileWeb– (Trilinos/packages/common)– http://software.sandia.gov/trilinos/developer/doxygen.html

• Package pages:– TrilinosWeb/packages/PACKAGE/

Questions

Test Harness & Website