41
www.labsmartservices.com.au CBR - 2018 (81) PROFICIENCY TESTING PROGRAM REPORT Accredited for compliance with ISO/IEC 17043 Copyright: LabSmart Services Pty Ltd CBR Proficiency Testing Program - 2018(81) Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 1 of 41

CBR - 2018 (81) PROFICIENCY TESTING PROGRAM REPORT LabSmart Services PT...2.3 Program Summary Based on LabSmart Services programs there has been an observable improvement in CBR testing

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

www.labsmartservices.com.au

CBR - 2018 (81)

PROFICIENCY TESTING

PROGRAM REPORT

Accredited for compliance with ISO/IEC 17043

Copyright: LabSmart Services Pty Ltd

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 1 of 41

Report This report is available on the LabSmart Services website. The issue of this proficiency report was authorised by Peter Young, Director, LabSmart Services Pty Ltd, January 2019. Contact Details

Email: [email protected] Mobile: 0432 767 706 Fax: (03) 8888 4987

Program Coordinator The program coordinator for this program was Peter Young, Director, LabSmart Services Pty Ltd. Contact Details

Email: [email protected] Mobile: 0432 767 706 Fax: (03) 8888 4987

Accredited Proficiency Testing Provider LabSmart Services is accredited by NATA to ISO/IEC 17043, Conformity assessment – General requirements for proficiency testing. Accreditation number 19235. The accreditation provides additional assurance to participants of the quality and importance we place on our proficiency testing programs.

LabSmart Services Please see our website for further details.

www.labsmartservices.com.au

Copyright This work is copyright. No part of this publication may be reproduced in any form, transmitted or stored in any repository (e.g. mechanical, digital, electronic or photographic) without prior written permission of LabSmart Services Pty Ltd. Please contact LabSmart Services Pty Ltd should you wish to reproduce any part of this report.

Z-Score Summary Z-score summary for this program issued 13 November 2018

Amendment History Reports may be downloaded from the LabSmart Services website.

Version 1 – Issued 29 January 2019

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 2 of 41

CONTENTS PAGE

1. Program Aim

5

2. Performance

2.1 Performance assessment 2.2 Identified outliers 2.3 Program summary

5 5 5 7

3. Technical Comment

3.1 General

3.1.1 Measurement uncertainty 3.1.2 Supply of test information 3.1.3 Errors

3.2 Statistics

3.2.1 Accuracy of data 3.2.2 Variation in CBR results 3.2.3 Set s.d limit 3.2.4 Repeatability

3.3 CBR results

3.3.2 CBR results 3.3.3 Identification of inconsistencies and errors

3.4 Direct influences

3.4.1 Load cell 3.4.2 Seating load 3.4.3 Penetration rate 3.4.4 Test (penetration / load) data 3.4.5 Accuracy of the graph prepared 3.4.6 Zero-point correction 3.4.7 Rounding

3.5 Indirect influences

3.5.1 Pre-compaction curing 3.5.2 CBR compaction 3.5.3 OMC & MDD 3.5.4 LDR & LMR

8

8 8 8 9 9 9 10 11 11

11

11 12

12

12 13 13 14 15 16 16

17

17 17 19 19

4. Statistics: Z-Scores & Graph

CBR Z-scores : Sample A

22

22

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 3 of 41

5. Program Information

5.1 Z-score summary 5.2 Program design

5.2.1 Design 5.2.2 Selection of material for program 5.2.3 OMC & MDD 5.2.4 Role of proficiency testing 5.2.5 Participant assessment 5.2.6 Reporting of results – significant figures 5.2.7 Additional test information requested 5.2.8 Data checks

5.3 Sample preparation 5.4 Packaging and instructions 5.5 Quarantine 5.6 Sample dispatch 5.7 Homogeneity testing 5.8 Participation 5.9 Statistics

5.9.1 Z-score Summary 5.9.2 Comparing statistics from one program to another 5.9.3 Measurement uncertainty 5.9.4 Metrological traceability

5.10 Non-statistical

24

24 24

24 24 25 25 26 26 27 27

28 28 28 28 28 29 29

30 31 31 31

31

6. Participants’ Test Results

32

Appendix A Instructions for testers

Appendix B Results log

Appendix C Graph example

37

39

41

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 4 of 41

1. Program Aim

The proficiency program was conducted in September/October 2018 with participants

throughout Australia. The program involved the performance of:

AS 1289.6.1.1 (2014) – Determination of the California Bearing Ratio of a soil –

Standard laboratory method for a remoulded specimen.

The program provides feedback and confidence to the construction materials testing

industry regarding the competency of participants (and the industry) to perform this

test. Each participant’s performance is statistically assessed and used as a measure

of competency relative to all those who participated. Other measures of performance

are also used (Section 5.2.5).

This report has been prepared using robust statistics. In addition, test data has been

reviewed for consistency. Comprehensive technical comment is provided to assist

participants improve the overall performance of this test (Section 3). Information

regarding the conduct and design of the program etc. can be found under section 5.

2. Performance

2.1 Performance assessment In discussing the outcome of this program, the following have been used to determine aspects of testing performance that needs to be investigated or reviewed. Statistical • Z-scores based on submitted CBR results

Non-statistical • Errors

• Identification of inconsistences

• Non-adherence to test method

• Accuracy of calculations

• Accuracy of graphing

See section 5.2.5 & 5.10 for further detail.

2.2 Identified outliers

In most proficiency testing programs the identification of outliers is relatively straight

forward. This is not the situation with CBR testing due to the large standard deviation

in CBR results obtained. There are also many steps in the testing process that

contribute to the quality of the CBR result.

Participants with statistical outliers, departure from the test method or errors need to

investigate the aspect of testing shown in table 2.2A. Those with significant departures

compared to other participants need to review the aspects summarised in table 2.2A.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 5 of 41

Participants where there is a concern regarding accuracy of the results or summited

data are requested to investigate their submissions. Others have been identified as

able to benefit from reviewing their submissions where it is felt the quality of testing

may be improved.

In table 2.2A there are no participants listed under some sections as needing to

investigate (e.g. ‘penetration rate’ and ‘test data’). This is not because there are no

concerns identified only that the test method does not necessarily identify, address or

quantify these aspects of the test affecting the accuracy/precision for this test.

The more times a participant’s code appears in the table 2.2A the greater the need for

follow up.

Aspect of testing Section Investigate Review

Supply of test information 3.1.2 B5 -

CBR results 3.3.2 Z8 T5, B5

Identification of inconsistences and errors 3.3.3 L3 -

Load cell 3.4.1 - T5

Seating load 3.4.2 - -

Seating load set to zero 3.4.2 - -

Penetration rate 3.4.3 - -

Test data (Load /Penetration points) 3.4.4 - F4, M9

Accuracy of graph 3.4.5 - T5, V9, P9, Z8,

B5

Zero-point correction 3.4.6 - -

Pre-compaction curing 3.5.1 A8, P9 -

CBR compaction 3.5.2 - Y8, W9, M3, V3,

U4, J2

OMC & MDD 3.5.3 - -

LDR 3.5.4 T5 -

LMR 3.5.4 A8, P9, U4, U5,

U6 -

One or more inconsistent results or calculations. Insufficient data on log sheet.

3.5.4 B5 -

Table 2.2A – Participants identified where investigation or review follow up is warranted.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 6 of 41

2.3 Program Summary Based on LabSmart Services programs there has been an observable improvement in CBR testing over the last ten years as measured by the coefficient of variation (CV). The last three programs have levelled out at a CV of around 23%. (Table 3.2.2A) Laboratories have done very well with fewer outliers compared to previous programs. A very good outcome and within the expectations of the test method. To the many participants and organisations who have participated “well done” and

“thank you” for your participation.

The program identified those aspects of the test that affect accuracy (direct influences) and those aspects of the test that are less controllable (indirect influences). The CBR graph would appear to be the only way of checking the validity of the results obtained. In many cases the graphs prepared do not adequately fulfil this function. A continued reduction in testing errors, better graphing and supervisor checking would greatly improve the accuracy of CBR testing. Improvements to the test method, by better defining the test process (e.g. graphing), limits and expected outcomes would also significantly improve the accuracy of the test. It should be noted that most of the above comments relate to the accuracy of the test. It is unlikely that improving the accuracy of testing is going to improve the current variation in CBR results shown. Enough proficiency programs have now been conducted to show that the current spread (variation) in results is both a reliable and accurate estimate. This proficiency program provides increased understanding of current test practices and potential sources of variation. It also allows monitoring of improvements in testing and provides the opportunity for participants to improve their competency. A summary of the program statistics is shown in Table 2.3A.

Statistic CBR

Number of participants 29

Median 50.7

Normalized IQR 11.6

Minimum* 19.1

Maximum* 73.5

Range* 54.4

CV (%) 23

Table 2.3A Summary of statistics for the CBR program. Some results have been rounded. *Min, Max & Range are with outliers excluded.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 7 of 41

3.0 Technical comment 3.1 General 3.1.1 Measurement Uncertainty

Aspects of the test can be split into whether they have a direct (measurable) or indirect

(not measurable) impact on the calculated CBR result. This is part of the process

taken when calculating measurement uncertainty.

Direct influences can be measured or estimated (section 3.4). Direct influences

generally involve participant errors or inconsistencies in testing. Testing can be

improved by improving the accuracy with which these aspects of the test are

performed. For example:

➢ Accuracy of the load cell

➢ Accuracy of seating load

➢ Accuracy of penetration

➢ Accuracy of the rate of penetration

➢ Accuracy of recording force readings

➢ Number of data points selected

➢ Accuracy of the graph prepared

➢ Accuracy of the zero correction

➢ Rounding of results

Indirect influences cannot be practically measured or improved easily (section 3.5).

Indirect influences generally involve non – compliance to the test method

requirements or limits. Test variation is minimised by strict adherence to the test

method. For example:

➢ OMC & MDD

➢ Moisture content

➢ LDR & LMR

➢ Compaction i.e. layer thickness,

compaction pattern, number of blows

➢ Curing of sample

3.1.2 Good laboratory practice

Proficiency program participants are expected to comply with the requirements of the program and meet basic laboratory standards. Good laboratory practice covers those aspects of laboratory operations that are in keeping with NATA accreditation. Some aspects that are particularly relevant for this program are:

➢ Supervision of testing

➢ Following the test method

➢ Following proficiency testing instructions

➢ Correctly filling out paperwork i.e. PT log sheet

➢ Checking of calculations and data i.e. free of errors

➢ Reality check of results i.e. does it fit the type of material submitted

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 8 of 41

Compared to earlier CBR proficiency testing programs there has been significant improvement in most of the above areas. However as detailed in subsequent sections there is still room to improve the performance of CBR testing. If participants are not meeting the above basic requirements it also raises concern as to what other omissions or errors are occurring during testing that remain undetected. 3.1.2 Supply of test information

Most participants supplied all the testing details requested. This additional information

(see section 5.2.7) is important as it is used to validate the results received and to

assist in providing the feedback given in the following sections.

Participants are always welcome to contact the program coordinator if they require

further explanation as to what information is required or how to proceed with testing.

There were several participants that did not supply all the data requested or supplied

incorrect data. These participants are encouraged to review what they have submitted

against other participants in order to improve data supplied in future. Participant B5

needs to investigate why only the CBR result was supplied.

3.1.3 Errors

Errors may arise from several sources, an incorrect calculation, transcription error, wrong methodology used, not following the test method etc. Many of the comments in the following sections relate to errors. Although some of these may have only a small impact they do accumulate. Others can have a large impact such as incorrect graphing technique and zero correction.

3.2 Statistics

The use of statistics are a very useful and practical means of analysing test data.

Below are some aspects that affect statistical outcomes.

3.2.1 Accuracy of data

If the test data is in error, then any statistics calculated may also be in error. Any

interpretations made, based on the statistics, may therefore also be in error. Most

proficiency programs can handle a few inaccurate results without any concern about

the veracity of the program outcome. Most of the technical comment concerns the

accuracy of the CBR test results.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 9 of 41

3.2.2 Variation in CBR results

Enough proficiency programs have now been conducted to show that the current assessment of the spread (variation) in results is both reliable and accurate (table 3.2.2A).

The standard of CBR testing has improved and the spread in results (variation) has

decreased over the last 10 years.

The coefficient of variation (CV) has settled at around 22%. Note that the ‘gold’ highlighting in table 2.3A shows programs conducted to the current 2014 test method.

Year Program Median CV

2018 81 51 23

2017 74 52 21

2016 67 155 21

2015 59 140 20

2014 54 74 31

2013 46 37 29

2012 37 44 20

2011 48 61 35

2009 16 30 32

Table 3.2.2A Comparison of CBR program results for the last nine years

Industry has expressed concerns that from an engineering “End User” perspective that

such large variations in CBR results are impractical. It is also undesirable from a

laboratory testing perspective. However, without changing the test method, the

variation is what the current method produces.

As has been indicated in previous proficiency programs, it is the middle 50% of

participants results that is far larger than it should be. It is this group of results

therefore that is of primary interest when considering ways in which to reduce the

spread of results.

Much of the technical feedback relates to improving the accuracy of CBR testing. This will not improve the spread of results, but they will become more accurate. Further work on improving the test method is needed in order to improve (decrease) the spread shown by the middle 50% of participants.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 10 of 41

3.2.3 “Set s.d limit”

In previous CBR proficiency programs the z-score statistics have been recalculated

using a “Set s.d limit” or “Target s.d”. The purpose of which was to bring the variation

(spread) in results back to something useful to geotechnical engineers and others in

the industry. It appeals as a very practical way of approaching the problem.

There is no reason however to suspect that, based on the outcome of this program,

or other programs that any result within the middle 50% is better than any another

result from the middle 50%. The “Set s.d limit” outcome then does not provide any

useful information.

If the accuracy of many CBR test results is questionable along with the median value,

then results may lie above or below any ‘set limits’. It does not identify problems or

inaccurate results, worse, it could indicate results as being satisfactory when they may

not be.

The “set limits” is therefore no longer used in CBR PT programs.

3.2.4 Repeatability

This program focuses on the variation (spread) of results between laboratories

(reproducibility).

It is questionable that with the large variation shown in CBR results that an estimate

of repeatability (performance of two identical samples) would yield reliable information.

For some tests the homogeneity data can be used as a guide to the repeatability.

However, for CBR such an estimate may be unreliable as the precision may be good

(same machine and pace rate etc) but it is unknown if the overall accuracy is good or

poor.

3.3 CBR Results

3.3.2 CBR results

Z-scores and associated statistics were calculated on the CBR results as submitted

and are detailed in section 4. The following statistical outliers were identified as

detailed in table 3.3.2A. Participants with z-scores 2 or l -2 l and above should review

the results obtained.

CBR Z-scores

Investigate Review

Z8 T5, B5

Table 3.3.2A Participants identified as having statistical outliers in the program

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 11 of 41

3.3.3 Identification of inconsistences and errors

There are many steps within the conduct of the test (methodology) that can become a

source of error or where inconsistencies can occur. As well there are limits posed by

the test method itself that may also contribute. For example, compaction and moisture

content. See section 3.4 and 3.5 that explore these aspects further.

The use of a detailed CBR graph is a quick and reliable means of checking results. A

rough mathematical check was undertaken by the program coordinator for all

participants. Those with significant differences were regraphed and the CBR

recalculated.

The CBR result for one of the participants (L3) had not been calculated correctly. The

results for this participant was amended and is shown in green in section 4.

Participant L3 needs to investigate the reason for the incorrect result.

3.4 Direct Influences

The following sections cover many aspects of test methodology. From previous

programs it has been noted that even with corrections resulting from re-graphed data

and using unrounded results it has only a marginal effect on the middle 50% of

participants. In other words, the corrections tend to be random with some corrected

CBR values increasing while others decrease.

Overall it suggests that while the accuracy of testing can and should be improved there

may be little change to the overall spread of results obtained for the CBR test.

3.4.1 Load cell

In section 6 the load values are shown for each participant. Some laboratories used

more data points than requested (great to see).

Most participants in this program used load cells with two participants (T5 & U4) that

used load rings. Most devices were calibrated to ‘Class ‘A’ or a combination e.g.

A/B/C. Participants generally used a 50 kN load device with CBR values occurring

around 10 kN.

Selection of the correct load cell capacity is dependent on the experience of the

laboratory and where possible prior knowledge of the material to be tested.

Unfortunately, due to the large range of CBR results possible from participants, this

information cannot be given by the program organisers prior to testing.

If a load cell or ring does not have enough capacity during testing it is important that

testing be stopped on approach to the maximum capacity of the load cell. Exceeding

the capacity of a ring can cause permanent damage (not visually obvious to a user).

Participant T5 should review the size of the load cell used for this program.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 12 of 41

Another consideration is the resolution at the lower end of the load scale to accurately

measure the seating load. For load cells used in this program that are on the larger

side (e.g. 50kN or above) it may be difficult to accurately measure small loads.

Often this is not a lack in ability of the load cell but a reflection of the normal calibration

practise where the calibration may not extend to the low load values required for

seating loads or low CBR values. Laboratories may need to request calibration

facilities, where possible, to specifically cover the seating loads required when

undertaking the load cell calibration.

3.4.2 Seating load

The test method requires that the least amount of force be used for the seating load.

It is important that the piston is in contact with a stable surface. The seating load is

considered the ‘zero point’ from which the load values and penetration commence.

In this program the CBR was greater than 30% and a seating load of 250 N should

have been used. Thirteen participants (68%) used the correct seating load. The test

method indicates that 50N should be used for CBRs less than 30%.

At high CBRs the seating load has only minimal effect on the CBR obtained but does

influence where the penetration points fall. For this type of material any effect of

incorrect assignment of the zero penetration is usually cancelled out with the zero-

point correction offset if performed correctly.

All participants indicate that the seating load was set to zero except for participant U4.

Participant U4 used a load ring where setting the dial gauge to zero could introduce

an error in the force calculated.

Not setting ‘back to zero’ again can lead to an inaccuracy in the load scale creating an

offset.

However, errors in both processes (seating load applied and resetting back to zero)

may influence the CBR. An error in penetration of ± 0.5mm could lead to a change of

± 4.5% CBR. This may not seem much but in the rounding process when reporting

this may cause a difference of 10% in the CBR result.

3.4.3 Penetration rate

The test method indicates that the machine used must be capable of “….forcing the

penetration piston into the specimen at uniform (not pulsating) rate of 1.0± 0.2 mm/min

during the complete test….”.

NATA indicates that the penetration rate be checked every two years.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 13 of 41

It is not entirely clear, based on input from previous programs, if the standard means

an ‘average rate’ or if it means it must be met at ‘all times’. If it is taken as an average

rate then theoretically you could have half the penetration at 0.5 mm/min and the other

half at 1.5 mm/min and still arrive at the average rate of 1.0 mm/min.

For ‘hand’ operated devices it is hard to check other than an overall average. A

motorised platform was used by most participants with four participants (W4, J2, Y8,

V3) using a hand operated unit.

With load cell units, they usually allow the rate to be checked as you go on a ‘per 0.5

mm of travel’ etc. This can be done on a ‘test by test’ basis so is a very good record

of meeting the requirements of the standard.

In previous programs the rate was requested with most participants reporting the test

method requirement rather than the actual rate achieved. For this program more

detailed information was requested from participants, i.e. average, minimum and

maximum rates achieved.

Around 45% of participants accurately completed this section of the log sheet. Those

that did provided the information all meet the requirements of the test method.

The penetration rate is linked to the slope of the load/penetration curve. It is therefore

significant in determining the CBR and hence the set limits placed on the rate of travel

by the test method.

3.4.4 Test (penetration / load) data

The number of penetration points selected is extremely important. Most participants

recorded the requested additional load/penetration data, and some recorded more. A

very good outcome. Participants F4 and M9 should review the number of data points

submitted.

The test method specifies a minimum data set (0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 4.0, 5.0, 7.5,

10.0 and 12.5 mm penetrations).

The ‘key’ word in the test method is “at least”. In other words if you know the material

well (i.e. have a CBR history of the material) then you should be able to use fewer

points otherwise you need to record loads at more points.

Additional data points are needed to:

➢ Allow for the discount of an abnormal data value ➢ Have sufficient points left so that the discounting of a point does not

compromise the test result ➢ Have sufficient points to fit a straight line and a curve ➢ Have sufficient points above the straight section of the graph. ➢ Have sufficient points to be able to tell that you have an abnormal data point

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 14 of 41

It is evident also that two few data points can have a measurable difference on the

result that is obtained as much as suspect data. Greater confidence in the result and

accuracy is obtained when more points are taken.

Approximately 45% of results submitted were checked and found that the data points

submitted were sound and suitable for curve fitting. This was a good outcome.

3.4.5 Accuracy of the graph prepared

In the previous CBR proficiency program all participants results were re-graphed. In

this program, only a selected group (45%) have been re-graphed. Consequently, any

inconsistencies found will not need to be investigated.

Graphing is discussed in this program due to its importance in deriving an accurate

result and being able to check the CBR result obtained. The CBR test method does

not emphasis this aspect.

Graphing of results has been an issue for the last ten CBR proficiency programs.

Overall graphing has improved vastly over this time.

Regardless of what graph is submitted to the client a detailed graph for use by the

laboratory is important as it is the primary method of checking that a reasonable result

has been obtained.

The test method is also not very descriptive regarding the quality of the graph

prepared. In previous proficiency programs, considerable feedback was given. An

example graph is given in Appendix C of the level of detail considered useful.

Only three participants did not submit a graph (V9, Z8, B5). All other participants had

computer generated graphs. Theses participants need to review the lack of a graph.

The standard overall was very good.

From Table 3.5.5A it shows a variation of results due to the accuracy of graphing. The

difference in CBR results shown are significant.

If the z-scores for all participants were recalculated with these three amended

CBR results (P9, Z8, T5) the NIQR increased by 1.04 and the CV increases by 1.9

%. This indicates the effect incorrect results in a program can have on the participant

performance outcomes (z-scores).

Participants shown in Table 3.4.5A need to review their results.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 15 of 41

Participant Recalculated Review Participant Recalculated Review

Participant Code

Zero Correction

(mm)

Zero Correction

(mm) Difference

Unrounded CBR (%)

Unrounded CBR (%)

Difference

T5 0 2.1 -2.1 19.1 32.1 -13

P9 0 1.2 -1.2 58.4 74.7 -16.3

Z8 2.2 3.4 -1.2 14.5 18.8 -4.3

Table 3.4.5A Selected participants – Re-graphed CBR data results

3.4.6 Zero-point correction

Overall, most participants calculated a zero-point correction and applied it. Seating load and zero correction combined generally result in small changes.

However sometimes small changes can have a significant effect on the CBR result

and particularly when a BR value is to be rounded either up or down to the nearest

10%. A variation of ± 10 % CBR is not unrealistic.

Not applying the zero-point correction does have a significant impact as shown in table

3.4.5A.

3.4.7 Rounding of CBR

The reason for rounding is not entirely clear in the Australian Standard. It perhaps

acknowledges that CBR values are quite variable and rounding makes the results

easier to use and compare when grouped together i.e. takes out some of the

fluctuation.

Laboratories were asked for the unrounded Bearing Ratio rather than rounded CBR

results. Part of the design consideration of this program was to try and isolate as well

as minimise sources of variation. The process of ‘rounding’ was identified as adding

to the variation of determining CBR. The statistics associated and test variation with

the CBR results will often increase slightly if rounded results are used. At other times

it may slightly decrease the variation shown.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 16 of 41

3.5 Indirect Influences

The following aspects of testing methodology are difficult to relate to the final CBR test

result. They can be measured individually but the influence it has on the CBR result

is more difficult due to the ‘unknown interactions’ they have on each other.

It is clear however that more accurate measurement of these aspects of the test in

conjunction with better definition within the test method should assist with improving

the overall accuracy of the test.

3.5.1 Pre-compaction curing

There were a range of curing times used by participants. The majority used 48 hours and above. The curing times specified by the test method are minimums. More curing, if done correctly, is better than less.

The test method now requires laboratories to select the appropriate curing time based

on material, Liquid Limit and departure from OMC.

There were a wide range of ‘liquid limit’ values used and hence a wide range of curing

times. The 2017 amendment to the test method allows for the ‘liquid limit’ to be

estimated based on experience. Most participants (approximately 70%) based the

curing on their ‘estimate’ of ‘liquid limit’.

A few used 24 hours with the majority choosing to cure for 48 hours or more. Only

one participant had a lower curing of 5.75 hours.

An estimate of the MC of the material ‘as received’ and whether within 2% of the OMC

was not specifically requested as part of this program.

Section 6c of the test method requires the material to be within ±0.5% of the specified

moisture. For this program OMC was 10.3%. The allowed range then was 9.8 to 10.8

%. The following participants (A8 & P9) indicated MCs outside this range and should

investigate.

3.5.2 CBR compaction

The proficiency program required participants to perform the CBR compaction using the OMC and MDD values provided and 100 % standard compaction. Test methods relating to compaction are very specific about the energy input into the process. This is largely governed by the spread of hammer blows and the number of blows used. The revised CBR method now stipulates the pattern to be used when compacting the CBR mould. The test method however does not specifically require the number of blows delivered to be recorded. As it is an important part of the test it should be recorded.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 17 of 41

It is expected that by compacting a calculated amount of material to a set height that the desired density will be achieved. The blows will vary depending on the material type and moisture. Depending on how this is done a variation in the number of blows per layer is the typical outcome. However, between layers these should remain reasonably close. For determination of OMC/MDD using standard compaction 25 blows per layer is used. To achieve the same energy input around 53 blows is required for the larger CBR mould. More or less blows than 53 may be needed for a variety of reasons.

• Inaccuracy of the OMC and MDD initially

• Blows not delivered in a regular pattern

• Nature of the material may cause it to move around the mould excessively

• Material added is higher or lower than the prescribed layer depth The blows delivered provides an insight into whether any of the above issues may have had an effect. Relying on the dry density calculated is useful but it is a calculated value and dependant largely on how representative and accurate was the moisture determination. How much variation is reasonable? This is at present unknown but for this program a variation of 40 to 60 has been used with a variation between layers of 5 blows. This criterion is meet by most participants. The following participants shown in table 3.5.2A do not meet this criterion and should review their results. Those shown in bold have more than 5 blows between layers.

CBR Compaction

< 40 Blows per layer

> 60 blows per layer

Between 40 and 60 blows but greater than 5 between

layers No result

Y8, W9, - M3, V3, U4 J2

Table 3.5.2A Participants with high or low number of compaction blows.

It may not affect the dry density obtained but there is concern that it may influence the CBR obtained.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 18 of 41

For low compaction it may influence:

• segregation of particles

• uneven compaction, For high compaction, effects such as:

• orienting the soil particles,

• segregation of particles

• causing fissures,

• breaking up of particles

• uneven compaction, all of which could influence the CBR without affecting the dry density value achieved. CBR results may be higher or lower depending on the influence. It is unclear if this has been investigated in recent times. 3.5.3 OMC & MDD

Different determinations of OMC & MDD by different laboratories will give rise to a

spread of results (Variation). To limit the effect of this variation on the CBR testing in

this proficiency program the OMC & MDD have been predetermined. This information

was supplied to participants (See instructions Appendix A) so that all participants used

the same OMC & MDD values.

3.5.4 LDR and LMR

❖ Calculation of LDR & LMR

Participants were requested to submit:

• The sample moisture immediately prior to compaction (w1) in accordance with

clause 6(c) of the standard.

• Moisture content variation (wv)

• The Laboratory Moisture Ratio (LMR)

• The Laboratory Density Ratio (LDR) and

• Dry Density (before soaking)

These intermediate results are noted in the test method as needing to be reported or

required to determine compliance with the test method.

The reported LDR and LMR values were re-calculated using the reported moisture

from clause 6(c) and density (before soaking). It is suspected that several participants

had incorrectly reported the moisture of the sample as being that of ‘as received’.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 19 of 41

There were several participants that had difficulty in calculating the intermediate

results detailed above.

The participants listed in Table 3.5.4A showed inconsistencies in the values submitted

throwing doubt on compliance with the test method and should be investigated.

Information submitted Investigate

Moisture (Clause 6c) A8, P9, U4, U5

Variation in moisture content (not) reported A8, P9, U4, U6

LMR does not match reported moisture P9

LDR does not match reported dry density -

Table 3.5.4A: Participants with inconsistencies in calculating LMR and LDR

❖ Achievement of OMC & MDD

Participants were requested to compact the sample to 100 % standard compaction.

Overall most participants achieved the desired range for OMC and MDD which was a

very good outcome. Achieving the LMR and LDR is a requirement of the test method

and must be met for the results to be valid and hence reportable.

OMC

± 0.5%

Moisture Range

%

LMR Range

% Investigate

9.8 95.1

- 10.3

10.8 104.9

MDD

t/m3

Density Range

t/m3

LDR Range

± 1% Investigate

2.094 99.0

T5 2.115

2.136 101.0

Table 3.5.4B: Participants that are outside the limits set for LMR and LDR OR W1.

Participants with results outside these limits as detailed in Table 3.5.4B. It suspected

that in many cases LMR and LDR would have been shown to be achieved had the

participant calculated them correctly. CBR results outside the permitted LMR and LDR

ranges could have been rejected from the proficiency program but were retained in

this instance.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 20 of 41

This page has been left blank intentionally for formatting purposes.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 21 of 41

V9 50 -0.06 P9 58.4 0.66

N2 73.5 1.96 B5 22.4 -2.43

B3 58.7 0.69

M8 34.3 -1.41

L3 52.8 0.18

W4 41.8 -0.76

F3 NR

J2 73.3 1.94

Y8 54.8 0.35

W9 44.7 -0.52

M3 43.0 -0.66

Y7 46.7 -0.34

F4 66.7 1.37

M9 50.7 0.00

A8 67.8 1.47

Y5 52.4 0.15

C8 50.5 -0.02

K3 51.5 0.07

T5 19.1 -2.72

Z8 14.5 -3.11 #

V3 31.8 -1.62

F9 50 -0.06

L8 45 -0.49

U5 62.5 1.01

R3 66.3 1.34

N5 60 0.80

U4 40 -0.92

X2 55.4 0.40

Number of results 29

Median 50.7

Median MU 2.70

First Quartile 43.0

Third Quartile 58.7

IQR 15.70

Normalised IQR 11.64

CV (%) 23.0

Minimum 19.1 (14.5)

Maximum 73.5 (73.5)

Range 54.4 (59.0)

Note: A # indicates an outlier where the z-score obtained is either greater then

3 or less than -3. Codes for all participates are shown. The results column

shows a blank entry or "NR" for those participants that did not submit a result for

this test. Minimum, Maximum and Range are calculated with outliers excluded,

those in brackets include outliers. Particpants results that have been corrected

are shown in green.

4 CBR - Sample A: Z - Scores

CodeTest

Result %Z Score Code

Test

Result %

Z Score

Statistic Value

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 22 of 41

ReviewWeak

Consensus

Weak

ConsensusReview

Z-score

Strong Consensus

4 CBR - Sample A: Z - Score Graph

N2

J2

A8

F4

R3

U5

N5

B3

P9

X2

Y8

L3

Y5

K3

M9

C8

V9

F9

Y7

L8

W9

M3

W4

U4

M8

V3

B5

T5

Z8

-3 -2 -1 0 1 2 3

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 23 of 41

5. Program information 5.1 Z score Summary The proficiency program was conducted in September/October 2018. A ‘Z-score Summary’ summary was issued on the 13 November 2018. A copy was e-mailed to all participants who submitted results. The summary is intended as an early indicator of participant performance. This program report supersedes the z - score summary. Further information can be found in section 5.9 ‘Statistics’. The z-scores generally do not vary significantly between the “summary” and the “Final Report”. 5.2. Program Design 5.2.1 Design

This program is one of a series of CBR programs conducted by LabSmart Services over the last ten years. The CBR test is a complex test from a measurement uncertainty perspective despite its apparent technical simplicity. Unfortunately, the CBR test method does not provide guidance about some aspects of the test such as repeatability or reproducibility. There also appears a lack of guidance on both the performance and the interpretation of the test within the industry. The range of test results obtained in a proficiency program, for any given sample, has been far wider than is generally acceptable to the industry. This adds to the difficulty in interpreting the outcome of CBR proficiency testing programs. Part of the design of each program involves asking for the right information. The correct analysis of the data collected then allows feedback to be offered to enable participants to improve in the performance of this test. The program was designed to provide technical feedback regarding performance as well as possible improvements in performance. Other considerations involving the design of the program are detailed below. 5.2.2 Selection of material for the program

The test in this proficiency program is operator skill/experience dependant. Different materials are selected for each program to mirror the range of materials encountered in practice and hence the results obtained. The higher the CBR value the greater the variation encountered. This program provides a sample that gives results in the range that would be commonly tested by laboratories. It is expected that the level of experience/skill needed to perform these tests will present a reasonable assessment of the overall competency of the tester and industry performance.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 24 of 41

5.2.3 OMC & MDD

The determination of OMC and MDD is usually an initial stage undertaken prior to performing a CBR test. The determination of these two parameters can show a significant variation. In turn having an impact on the variation obtained for CBR results. The intention of the program is to minimise the influence on the CBR results that could arise from laboratories determining these values in-house and reduce the likelihood of different OMC and MDD values being applied. To assist in reducing this variation, participants were requested to use 100% standard compaction and use:

• OMC = 10.3%

• MDD = 2.115 t/m3. These values were determined prior to the program. This approach has been used to minimise variation however other aspect may still contribute to the variation observed. OMC/MDD values may vary from person to person but this may not be so important if the same person determines OMC/MDD and CBR. That is a low compaction on the OMC/MDD should give the same compaction on the CBR. Overall it is still considered that a set OMC/MDD will contribute the least variation. 5.2.4 Role of proficiency testing

The determination of outliers is an important task of this proficiency program. A secondary function is to provide feedback that can help those with outliers identify possible areas to investigate as well as assist all participants to improve. In addition to the statistics, proficiency programs often obtain other information that is not normally available to a laboratory. It allows for a better understanding of the testing and can provide information that can lead to improvements in the testing process or test method. Proficiency testing enables participants to measure competency against others. It is also a measure of staff performance and the equipment used. Apart from ‘measurement uncertainty’ it is the next most useful tool a laboratory has in better understanding the performance of a test.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 25 of 41

5.2.5 Participant assessment

In discussing the outcome of this program, the following have broadly been used to determine outliers and areas for investigation/review. Statistical • Z-scores based on submitted CBR results

Non-statistical • Errors

• Identification of inconsistences

• Non-adherence to test method

• Accuracy of calculations

• Accuracy of graphing Participants are asked to “investigate” statistical outliers. Assessment of each participant is based on a z-score that is related to the program consensus value (median). This is used to determine any statistical outliers. Errors in testing, test method not followed or where test parameters are outside the limits set in the test method all need to be “investigated”. See section 5.10. Other maters identified are shown as “Review”. These are matters that would help improve testing and it most cases would be considered outside normal testing parameters. It is sometimes difficult to determine as the CBR test method often does not provide enough guidance. Compliance to proficiency program requirements including the correct calculation of results and adherence to program and test method requirements may also be used as part of the assessment process (sees section 5.2.7). Participants may also be asked to investigate any discrepancies detected with the paperwork submitted. See section 5.2.8 for further details. 5.2.6 Reporting of results - Significant figures

The number of decimal places (significant figures) reported for a test has a bearing on the statistical analysis and therefore the interpretation of the results. There is a need to strike a balance between what is desirable from a statistical view point and test method accuracy while recognising how the results are used in practice. Too few decimal places (e.g. due to rounding) can cause an increase in the observed spread of results. Increasing the number of decimal places (with respect to normal reporting) can distort the observed spread of results compared to that encountered in actual practice. Large numbers of similar, rounded results can also cause a distortion in the analysis. For example, rounding to 10 % means that any number between 45 and 54 will become 50%. If the largest value is 45 in a set of results it is pushed out to 50 through rounding. Rounded results may better reflect the repeatability and reproducibility of the test according to the rounding in the test method but are not as useful when considering laboratory performance.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 26 of 41

For this program, it was decided that the benefits of using additional decimal places would complement the aim of the proficiency program. Participants results were analysed as received regardless of whether there were more or less significant figures than the number requested by the program. 5.2.7 Additional test information requested

This program requested additional information as detailed in Section 6 not usually reported. The additional information is however consistent with the performance of the test and the records the test method requires laboratories to maintain or is consistent with ‘good laboratory’ practice. The additional information is used to interpret participant’s performance and assist with providing technical comment including feedback on outliers and possible participant improvement. It is also used to validate the results received. Participant results can be rejected if they do not conform to the program requirements. The correctness and quality of the information supplied is assessed as to the veracity of the information or results submitted. An adverse assessment may lead to the whole of the participants results being rejected or asked to investigate/review some aspect of what has been submitted. 5.2.8 Data checks

As often observed ‘operator errors’ can occur in the result calculation process. Every participant’s results were verified as reasonable. Checks however are only as accurate as the raw data supplied by each participant. These checks also help ensure that the data is comparable. Any inconsistencies identified during this process are identified as possible feedback for participant improvement. In some cases, inconsistences identified may need to be investigated by participants. Proficiency testing providers are obligated under their accreditation standard to remove results known to be incorrect or where a participant has not followed the test method including adherence to prescribed limits. Not providing all data requested, particularly where it is used to assess the validity of the results obtained (e.g. compaction, MC) is also a valid reason to reject a CBR result. These matters are not ‘black & white’ but require some interpretation as to each component’s importance. Keeping results that may be suspect in the statistical pool may distort the statistical outcome. However, if all the results found to be inaccurate or not meet the test method etc. were rejected from this program the pool of results would be significantly decreased. A balance must be struck. Participants need to be aware that the program coordinator performing the checks may not have access to the full set of results for each participant (e.g. significant figures etc.). This can sometimes cause differences between what the participant has calculated and what the program coordinator calculates. Also, due to the large amount of data associated with this program it is entirely possible that the coordinator may not have recalculated some participants results correctly although considerable effort is made to prevent this from occurring.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 27 of 41

5.3. Sample preparation Sufficient material of a homogeneous appearance was obtained for the proficiency program. The lot was partially dried then mixed to ensure, as far as possible, a homogeneous material throughout. The material was sampled and placed into numbered plastic bags. Ten samples were drawn at regular intervals from the lot for homogeneity testing. Each participant received a randomly drawn sample from the remaining samples. A unique program code was assigned to each sample.

5.4. Packaging and instructions Each plastic bag was sealed with a rubber band and placed into a sturdy box. Each participant received one box with a sealed sample labelled ‘2018 (81) CBR Sample’. The sample weighed approximately 8 kg. Instructions and a ‘Results Log’ sheet were enclosed (See Appendix A & B). Participants were instructed to test according to the nominated test method and report to the accuracy indicated on the ‘Results Log’.

5.5. Quarantine There were no samples that needed to comply with quarantine requirements.

5.6. Sample despatch Samples were dispatched to participants early October 2018 via courier. Dispatched samples were tracked from ‘despatch to delivery’ for each participant.

5.7. Homogeneity testing Homogeneity samples were selected, evenly spaced, from the prepared participant samples. Samples for homogeneity testing were packed in the same way as those for all participants. The homogeneity samples were tested by an independent NATA accredited laboratory. To approximate the same conditions the same instructions were given to the laboratory performing the homogeneity testing. Ten samples were tested for homogeneity. Five samples had to be removed as either outliers or not representative of the statistical sample population. The overall variability associated with the homogeneity samples was considered satisfactory. The average of the homogeneity samples also lies within 1 s.d of the program median value. This provides confidence that any outliers identified in the program represent statistically valid outliers. A statistical analysis of the homogeneity testing results is provided in table 5.7A.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 28 of 41

5.8. Participation Thirty participants from around Australia entered the program. Twenty-nine participants returned results. Participants were requested to return results by 24 October 2018.

5.9. Statistics Z-Scores were calculated for each test and used to assess the variability of each participant relative to the consensus median. A corresponding z-score graph was produced for each test. The use of median and quartiles reduces the effect that outliers have on the statistics and other influences. Therefore, z-scores provide a more realistic or robust method of assessment. Some results were reported by participants to more decimal places than requested as part of the proficiency program and by others to fewer decimal places. In all instances test results have been used as submitted by participants. Assessment of participant’s data is undertaken to ensure data is statistically comparable. Checks are undertaken to ensure the data calculated matches that reported by the participant and that the appropriate corrections etc. have been applied if required. The level of checking required varies from program to program. If inconsistencies are identified the data may be removed or amended with the discrepancy highlighted.

Code

CBR

%

CBR

%

(Rounded)

H1 - -

H2 44.2 45

H3 43.0 45

H4 47.4 45

H5 47.0 45

H6 - -

H7 - -

H8 30.6 30

H9 - -

H10 - -

Mean 42.4 42

Standard Deviation 6.9 6.7

Range 16.8 16

Coefficient of Variation (%) 16.2 15

Table 5.7A Homogeneity results

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 29 of 41

A z-score is one way of measuring the degree of consensus with respect to the grouped test results. The z-scores in this report are an approximate of the standard deviation. For each test a z-score graph is shown. Use the graph to visually check statistically how you compare to other participants. The following bar (Figure 5.9A) is shown at the bottom of each graph. This helps to quickly visualize where each participant’s results falls.

Review Weak

Consensus Strong Consensus

Weak Consensus

Review

Figure 5.9A Z-score interpretation bar

For example:

• A strong consensus (i.e. agreement) means that your test result is close i.e. within 1 standard deviation of the median.

• A weak consensus means that your test result is satisfactory and is within 2 standard deviations of the median.

• If you have obtained a test result that is outside 2 standard deviations then it may be

worth reviewing your testing processes to ensure that all aspects are satisfactory. Only those obtaining a z-score approaching 3 (I.e. outside 2.75 range) have been highlighted in the report for review.

If you have obtained a test result that is outside 3 standard deviations then you will need to investigate your testing processes to ensure that all aspects are satisfactory. Participant assessment is not based purely on statistical analysis. Compliance to proficiency program requirements including the correct calculation of results and adherence to program requirements may also be used as part of the assessment process. Participants may also be asked to investigate any discrepancies detected with the paperwork submitted. See section 5.10. For further details on the statistics used in this proficiency program can be obtained from LabSmart Services or download the ‘Participant Guide’ from the LabSmart Services website. 5.9.1 Z-score summary

A “Z-Scores Summary” is issued soon after most results are received. It gives participants early feedback as to any program outliers. The summary is available on the LabSmart Services website up until the final report is issued. The final report supersedes the z-score summary. The final report contains detailed technical feedback regarding the performance of tests and revised z-scores. The inclusion of late results or corrections are at the discretion of the program coordinator. In some instances, this may change some of the z-scores slightly but generally the performance outcome remains the same. If there is any significant impact it will be discussed within section 5.1 of the report.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 30 of 41

5.9.2 Comparing statistics from one program to another

The statistics generated from one proficiency program are not usually comparable to those from another proficiency testing program. Only very general comparisons may be possible. The reason statistics from one program may not be compared to another is due to the range of variables that differ from one proficiency program to another. These variables include:

• Type of material selected,

• The number of participants,

• Experience of participants,

• Test methodology variations,

• Equipment used,

• Test methods used,

• Experience of supervisors,

• Range of organisations involved.

• Program design and the statistics employed.

The program outcome represents a ‘snap shot’ of the competency within the industry and hence provides an overview of the industry. The more participants involved in the program then the more representative the overview. 5.9.3 Measurement uncertainty

The statistics detailed in this program do not replace the need for laboratories to separately calculated measurement uncertainties associated with each test when required by the client or NATA. The proficiency program does give information useful for calculating the MU and bench marking the MU calculated. 5.9.4 Metrological traceability

The assigned median value used in this proficiency testing program is derived from participant performance and is not metrologically traceable. 5.10 Non-statistical One of the issues faced by proficiency testing providers is what to do with an incorrect result even if its z-score is satisfactory. In many cases they cannot be detected but still can have a significant impact on the statistics calculated. This can cause biased (or unfair) outcomes for other participants. To limit the effect that erroneous results may have on a program additional information is requested to allow the main results to be recalculated. In some cases, results shown to be erroneous may be rejected for inclusion in the program. If the result does not add any statistical bias it is left in the program. The result however is incorrect even though it may have a satisfactory z-score. To highlight that the participant needs to investigate, ‘non-statistical’, erroneous results. This may also be applied to non-compliance to program requirements e.g. incorrect reporting of results etc or incorrect partial calculations/data.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 31 of 41

Code V9 N2 B3 M8 L3 W4 F3

Moisture-Before compaction - W1 (%) 10.1 9.9 10.2 10.1 10.3 10.6

Moisture Content Variation - Wv (%) 0.2 0.4 0.1 -0.2 0.0 -0.3

Compaction (Manual or Auto) M M M M M M

Compaction Method - Standard (Y/N) Y Y Y Y Y Y

No. blows per layer 53/53/53 53/53/53 45 54/54/54 53/53/53 45/49/48

Dry Density g/cm3

2.119 2.127 2.118 2.117 2.115 2.109

Density Ratio (LDR) % 100.2 100.6 100.1 100.0 100 99.7

Moisture Ratio (LMR) % 98.0 96.1 99.0 98.1 99.6 102.9

BR @ 2.5 mm (%) 45 61.9 45.7 33.2 31.5 31.8 NR

BR @ 5.0 mm (%) 50 73.5 58.7 34.3 52.8 41.8 NR

CBR (%) 50 73.5 58.7 34.3 52.8 41.8 NR

Correction (mm) 2.5 1.1 0.5 0.0 0.16 1.3

Swell (%) 0.0 0.0 0.0 0.0 0.02 0.0

Moisture ww 12.6 11.3 11.3 11.6 10.3 12.6

Moisture w30 11.0 13.0 11.4 11.3 13.8 11.9

Moisture wr 10.4 10.8 NR 11.1 10.9 11.0

Date last calibrated 2/03/2017 6/06/2018 12/07/2017 12/09/2017 8/10/2018 24/11/2016

Calibrated range (kN) 0-50kN 0.05-50 0-50kN 0-50kN 0-50kN 4-40kN

Load cell (C) or ring (R) C C C C C C

Calibration Class (AA, A, B, C etc) A/B/C A A C A/B A

Hand driven (H) or motorised (M) M M M M M H

Rate of penetration (mm/min)

Average 0.98 90 1.1 NR 0.9498 NA

Lowest 0.99 92 NR NR 0.8916 NA

Highest 1.02 104 NR NR 1.008 NA

Condition of material Good OK Satisfactory OK Sealed Good

Seating load applied (N) 0.046kN 50 Yes 0.250kN 0.035kN 40

Seating load set to zero (Y/N) Y Y Y Y Y Y

LL determined by clause(5d)1, 2 or 3 3 3 3 1 1 3

LL value used Low Low 30 Low 28.4 Low<35

Period Cured (hours) 48 48 72 48 171.75 78

Graph computer or hand (C/H) NR C C C C C

Loads in ( N or kN ) kN N N kN kN kN

0 0.0 50 0 0 0.000 0

0.5 0.717 156 730 1.168 1.138 0.284

1 1.646 725 1590 2.256 2.693 0.645

1.5 2.716 1790 2620 3.148 3.962 1.143

2 3.866 3201 3690 3.858 5.098 1.714

2.5 5.056 4814 4950 4.375 6.243 2.400

3 6.219 6378 6030 4.819 7.237 3.088

3.5 7.333 8010 7040 5.262 8.145 3.784

4 8.289 9550 8200 5.703 8.957 4.536

4.5 9.258 11050 9430 6.214 9.718 5.361

5 10.175 12384 10560 6.792 10.463 6.057

6 11.959 14602 12770 8.035 11.856 7.653

7.5 14.270 17312 15900 9.815 13.789 10.134

8 14.950 18133 16880 NR 14.367 11.043

10 17.590 21254 20580 12.578 16.729 14.0010.512.5 20.761 24550 24420 15.199 19.392 17.14

Code V9 N2 B3 M8 L3 W4 F3

Number 1 2 3 4 5 6 7

Table 1 of 5

6 Participants Test Results

Note: Blank or NR = No result returned, Green are calculated/corrected results by PT coordinator.

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 32 of 41

Code J2 Y8 W9 M3 Y7 F4 M9

Moisture-Before compaction - W1 (%) 10.1 9.9 10.3 10.3 10.2 10.0 10.2

Moisture Content Variation - Wv (%) -0.2 -0.6 0.0 0.0 0.1 0.3 0.1

Compaction (Manual or Auto) M M M A M M M

Compaction Method - Standard (Y/N) Y Y Y Y Y Y Y

No. blows per layer NR 24/27/30 30/35/46 40/50/50 53/53/53 53/53/53 53/53/53

Dry Density g/cm3

2.118 2.123 2.107 2.115 2.117 2.118 2.113

Density Ratio (LDR) % 100.1 100.4 100 100.0 100.1 100.1 99.9

Moisture Ratio (LMR) % 98.1 96.1 100 100.0 99.2 97.5 99.0

BR @ 2.5 mm (%) 73.3 50 38.9 34.7 36.1 55.3 44.7

BR @ 5.0 mm (%) 72.1 54.8 44.7 43.0 46.7 66.7 50.7

CBR (%) 73.3 54.8 44.7 43.0 46.7 66.7 50.7

Correction (mm) zero 0.0 0.1 0.4 0.0 0.6 0.7

Swell (%) -0.1 -0.98 0.0 0.0 0.0 0.3 0

Moisture ww 11.7 11.6 11.8 11.6 11.1 11.2 11.2

Moisture w30 12.8 13.1 12.2 12.1 11.8 12.7 11.3

Moisture wr 10.6 10.6 11.1 10.7 10.8 10.8 11.0

Date last calibrated 8/12/2016 14/02/2017 26/06/2018 16/04/2017 21/02/2018 15/02/2017 19/06/2017

Calibrated range (kN) 0-50kN 0-50kN 0.001-50kN 0-100kN 0-50kN 0-60 0-50kN

Load cell (C) or ring (R) C C C C C C C

Calibration Class (AA, A, B, C etc) A A A A A A A

Hand driven (H) or motorised (M) H H M M M M M

Rate of penetration (mm/min)

Average NR 1mm/min 0.995 0.96 0.99 1mm/min 1.0

Lowest NR NR 0.97 0.83 0.96 NR NR

Highest NR NR 1.02 1.02 1.02 NR NR

Condition of material OK 7.5%MC Sealed Sealed NR Dry Moist Dry

Seating load applied (N) 250 250 250 0.025kN 250 120 250

Seating load set to zero (Y/N) Y Y Y Y Y Y Y

LL determined by clause(5d)1, 2 or 3 3 3 3 3 1 1 3

LL value used Low Low NR <30 26 Low <35 <35

Period Cured (hours) 144 96 24 48 150 48 48

Graph computer or hand (C/H) C C C C C C C

Loads in ( N or kN ) kN kN kN kN kN N N

0 0 0.000 0.0 0.008 0.000 0 0

0.5 2.043 0.958 0.877 0.497 1.383 687 349

1 4.459 2.250 1.879 1.262 2.194 1558 1100

1.5 6.621 3.609 2.957 2.150 3.009 2728 2190

2 8.386 4.888 3.981 3.089 3.888 4071 3315

2.5 9.672 6.069 4.921 3.991 4.769 5430 4543

3 10.660 7.046 5.757 4.832 5.696 6897 5616

3.5 11.574 8.062 6.557 5.634 6.605 NR NR

4 12.310 8.957 7.318 6.434 7.435 9580 7527

4.5 13.293 9.777 8.034 7.218 8.389 NR NR

5 14.274 10.557 8.675 7.988 9.256 11955 9147

6 16.271 12.433 10.050 9.486 10.970 NR NR

7.5 20.529 14.621 12.092 11.556 13.379 16751 12549

8 21.122 15.333 12.736 12.206 14.142 NR NR

10 23.401 18.300 15.257 14.753 16.979 20768 1566010.512.5 26.564 21.422 18.181 17.908 20.555 23992 18833

Code J2 Y8 W9 M3 Y7 F4 M9

Number 8 9 10 11 12 13 14

Note: Blank or NR = No result returned, Green are calculated/corrected results by PT coordinator. Table 2 of 5

6 Participants Test Results 6 Participants Test Results

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 33 of 41

Code A8 Y5 C8 K3 T5 Z8 V3

Moisture-Before compaction - W1 (%) 6.7 10.3 10.6 10.6 10.3 10.4 10.0

Moisture Content Variation - Wv (%) 10.3 0.0 0.3 0.3 0 -0.1 0.3

Compaction (Manual or Auto) M M M M M M M

Compaction Method - Standard (Y/N) Y Y Y Y Y Y Y

No. blows per layer 53 53/53/53 53/53/53 53/53/53 48/48/48 53 44/44/50

Dry Density g/cm3

2.094 2.132 2.105 2.099 2.089 2.132 2.119

Density Ratio (LDR) % 99.0 100.8 99.5 99.3 98.8 100.80 100.2

Moisture Ratio (LMR) % 99.7 100.4 103.0 102.7 100.0 101.40 97.4

BR @ 2.5 mm (%) 50.7 40.7 39.4 37.1 9.2 10.5 30.2

BR @ 5.0 mm (%) 67.8 52.4 50.5 51.5 19.1 14.5 31.8

CBR (%) 67.8 52.4 50.5 51.5 19.1 14.5 31.8

Correction (mm) 0.5 0.5 0.4 0.2 0 2.2 0.1

Swell (%) 0 0.0 0.0 0.5 0.0 -0.7 -0.1

Moisture ww 10.27 12.1 12.0 12.3 10.3 10.4 11.5

Moisture w30 12.48 12.0 12.0 13.3 11.2 12.4 11.5

Moisture wr 10.36 10.3 11.0 11.0 10.9 12.0 10.4

Date last calibrated 28/03/2012 10/11/2016 10/11/2016 30/01/2018 24/01/2018 4/07/2017 23/08/2018

Calibrated range (kN) 50kN 0-50kN 0-50kN 0-50kN 14kN 0.5-50kN 50kN

Load cell (C) or ring (R) C C C C R C C

Calibration Class (AA, A, B, C etc) A AA AA AA A A A

Hand driven (H) or motorised (M) M M M M M M H

Rate of penetration (mm/min)

Average NR 0.95 0.94 0.94 0.8mm NR NR

Lowest NR 0.92 0.90 0.90 0.8mm NR NR

Highest NR 0.98 0.97 0.98 0.8mm NR NR

Condition of material Good Good Good Good Sealed/Moist Good Sealed

Seating load applied (N) 50 0.25kN 0.25kN 0.25kN 0.04 NR 250

Seating load set to zero (Y/N) Y Y Y Y Y Y Y

LL determined by clause(5d)1, 2 or 3 2 1 1 1 Low NR 3

LL value used Low <35 28 27 <35 26 Low Low <35

Period Cured (hours) 48 48 48 48 48 24 48

Graph computer or hand (C/H) C C C C C NR C

Loads in ( N or kN ) kN kN kN N kN kN N

0 NR 0.00 0.00 0 0.00 0.021 0

0.5 0.409 0.64 0.67 514 0.19 0.108 960

1 1.153 1.44 1.43 1370 0.36 0.205 2050

1.5 2.114 2.34 2.31 2415 0.59 0.328 2810

2 3.743 3.34 3.34 3515 0.88 0.453 3380

2.5 5.280 4.34 4.36 4497 1.21 0.562 3880

3 6.824 5.37 5.38 5493 1.66 0.643 4390

3.5 8.308 6.39 6.40 6433 2.13 0.836 4910

4 9.709 7.44 7.38 7400 2.65 1.062 5450

4.5 11.016 8.43 8.33 8212 3.21 1.307 5820

5 12.280 9.43 9.24 9071 3.79 1.584 6210

6 14.501 11.35 10.85 10667 5.00 2.180 7050

7.5 17.336 14.09 13.17 12779 6.92 3.140 8250

8 18.182 14.96 13.89 13461 7.57 3.377 8610

10 21.356 18.26 16.64 16448 10.26 4.838 1032010.512.5 25.328 22.15 19.93 20420 13.46 6.745 12430

Code A8 Y5 C8 K3 T5 Z8 V3

Number 15 16 17 18 19 20 21

Note: Blank or NR = No result returned, Green are calculated/corrected results by PT coordinator.

6 Participants Test Results

Table 3 of 5

6 Participants Test Results

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 34 of 41

Code F9 L8 U5 R3 N5 U4 X2

Moisture-Before compaction - W1 (%) 9.9 10.5 9.9 10.3 10.6 10.2 10.3

Moisture Content Variation - Wv (%) 0.4 0.2 3.9 0 -0.3 99.3 0.0

Compaction (Manual or Auto) M M M M M M M

Compaction Method - Standard (Y/N) Y Y Y Y Y Y Y

No. blows per layer 44/44/44 44/44/44 53/53/53 56/60/60 53 55/60/50 50/50/50

Dry Density g/cm3

2.120 2.109 2.124 2.107 2.101 2.117 2.114

Density Ratio (LDR) % 100.2 99.7 100.4 99.6 99.3 100.1 100.0

Moisture Ratio (LMR) % 96.1 102.4 96.1 100.0 102.9 99.1 100.0

BR @ 2.5 mm (%) 40 35 50.6 53.1 45 25 44.1

BR @ 5.0 mm (%) 50 45 62.5 66.3 60 40 55.4

CBR (%) 50 45 62.5 66.3 60 40 55.4

Correction (mm) 0.7 1.2 0.7 0.3 1.0 0.5 0.2

Swell (%) 0.0 0.0 0.0 Nil 0.0 0.0 0.6

Moisture ww 10.9 11.8 11.7 12.1 10.3 10.2 12.2

Moisture w30 11.7 11.5 10.9 10.9 13.2 10.8 12.6

Moisture wr 11.7 10.6 11.2 11.8 10.2 10.0 11.2

Date last calibrated 7/05/2018 7/05/2018 16/08/2017 20/04/2018 17/09/2018 1/09/2016 24/07/2018

Calibrated range (kN) 45kN 45kN 0-50kN 0-50kN 0-50kN 10.3-50kN 0-50kN

Load cell (C) or ring (R) C C C C C R C

Calibration Class (AA, A, B, C etc) A A A A A A A

Hand driven (H) or motorised (M) M M M M M M M

Rate of penetration (mm/min)

Average 1.0 1.0 1.012 1.03 0.98 1.005 Average

Lowest NR NR 0.998 1.01 0.96 NR NR

Highest NR NR 1.052 1.05 1.00 NR NR

Condition of material Sealed Sealed Sealed Sealed NR 2.7%MC Good

Seating load applied (N) 250 250 4.5kg 0.15kN 47 100div 260

Seating load set to zero (Y/N) Y Y Y Y Y N Y

LL determined by clause(5d)1, 2 or 3 3 3 Visual NR 3 3 Visual

LL value used ≤35 ≤35 OMC supplied NR Low 30 Medium

Period Cured (hours) 48 48 5.75 48 48 24 48

Graph computer or hand (C/H) C C C C C C C

Loads in ( N or kN ) N N N kN N kN kN

0 0 0 0 0 47 0.00 0

0.5 449 197 521 0.855 285 0.51 0.96

1 1137 661 1256 2.066 656 1.08 2.21

1.5 1959 1284 2314 3.597 1293 1.71 3.44

2 2852 2143 3573 4.738 2251 2.37 4.61

2.5 3792 2778 4897 6.128 3416 3.09 5.72

3 4790 3448 6236 7.487 4501 3.83 6.87

3.5 5813 4201 7518 8.838 5667 4.59 7.95

4 6828 4903 8769 10.137 6825 5.41 8.95

4.5 7839 5717 9940 11.315 7988 6.25 9.88

5 8767 6576 11049 12.464 9063 7.04 10.76

6 10477 8274 13036 14.527 10997 8.65 12.40

7.5 12696 10376 15681 17.118 13732 11.07 14.72

8 13417 11080 16468 17.903 14698 11.81 15.42

10 16135 13947 19618 20.871 17783 14.67 18.1910.512.5 19089 17077 23393 24.226 21116 NR 21.19

Code F9 L8 U5 R3 N5 U4 X2

Number 22 23 24 25 26 27 28

Note: Blank or NR = No result returned, Green are calculated/corrected results by PT coordinator.

6 Participants Test Results

Table 4 of 5

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 35 of 41

Code P9 B5

Moisture-Before compaction - W1 (%) 7.1% NR

Moisture Content Variation - Wv (%) 3.2% NR

Compaction (Manual or Auto) M M

Compaction Method - Standard (Y/N) Y NR

No. blows per layer 53/53/53 NR

Dry Density g/cm3

2.132 NR

Density Ratio (LDR) % 100.8 NR

Moisture Ratio (LMR) % 99.2 NR

BR @ 2.5 mm (%) 31.4 13.2

BR @ 5.0 mm (%) 58.4 22.4

CBR (%) 58.4 22.4

Correction (mm) 0.00 NR

Swell (%) 0.00 NR

Moisture ww 11.4 NR

Moisture w30 11.3 NR

Moisture wr 11.0 NR

Date last calibrated 14/08/2017 NR

Calibrated range (kN) 0-50kN NR

Load cell (C) or ring (R) C NR

Calibration Class (AA, A, B, C etc) A NR

Hand driven (H) or motorised (M) M NR

Rate of penetration (mm/min) NR

Average 1mm/min NR

Lowest NR NR

Highest NR NR

Condition of material Undamaged NR

Seating load applied (N) 0.002 NR

Seating load set to zero (Y/N) Y NR

LL determined by clause(5d)1, 2 or 3 3 NR

LL value used ≤35 NR

Period Cured (hours) 48 NR

Graph computer or hand (C/H) C NR

Loads in ( N or kN ) N NR

0 0 NR

0.5 220 NR

1 490 NR

1.5 1390 NR

2 2650 NR

2.5 4170 NR

3 5670 NR

3.5 7240 NR

4 8740 NR

4.5 10200 NR

5 11600 NR

6 14070 NR

7.5 NR NR

8 18500 NR

10 22180 NR10.5 NR12.5 26110 NR

Code P9 B5

Number 29 30

Note: Blank or NR = No result returned, Green are calculated/corrected results by PT coordinator. Table 5 of 5

6 Participants Test Results

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 36 of 41

81 App A CBR PT Instructions V3.docx

LabSmart Services

Proficiency Testing Program

California Bearing Ratio – 2018 (81)

INSTRUCTIONS FOR TESTER

1. Please check that the package you have received contains the following:

➢ Instructions (for tester) ➢ Results Log ➢ Approximately 8 kg of soil sealed in a plastic bag labelled ‘2018 (81) CBR Sample’

Contact LabSmart Services if the bags are damaged or any item is missing.

2. When can I start testing? As soon as you have read these instructions carefully and

your supervisor has indicated that you may do so.

3. How long do I have to do the testing? You need to have the results back to LabSmart Services by the 24 October 2018.

4. Due to the possibility of segregation during transportation mix the sample thoroughly

prior to testing.

5. There is no oversize material present in this sample. 6. You do not need to be accredited for AS 1289 6.1.1. You may use other equivalent

methods but it is preferable that AS 1289 6.1.1 be used.

7. Conduct the CBR test to AS 1289 6.1.1 (2014) with the 2017 amendment using the following information.

➢ Use an OMC of 10.3 %.

➢ Adjust the moisture of the sample as per the test method mixing thoroughly at

intervals. This should be done in a plastic bag with the end tied/folded over or

similar.

➢ As per clause 6(c) of the test method just prior to compaction take a sample to

determine final moisture content (w1) has been achieved i.e. OMC ± 0.5%.

➢ Sample to be remoulded at 100% standard compaction.

➢ Use a MDD of 2.115 t/m3

➢ LDR be within 100 ± 1.0%

➢ Apply a 4.5 kg surcharge.

➢ Soak the sample as per the method for 4 days.

➢ Swell is to be determined.

➢ Take additional load readings at 3.5, 4.5, 6.0 and 8.0 mm penetration.

Page 1 of 2

Appendix A

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 37 of 41

81 App A CBR PT Instructions V3.docx

8. Please study the “Results Log” carefully before beginning the test.

9. Record the results on the enclosed “Results Log”. Report each result according to the log sheet. This will be different to the test method.

10. The Laboratory Manager or person responsible for checking must sign the log sheet to

indicate that it has been checked.

11. Please retain any unused sample until the final report has been issued.

12. Have a query? Contact Peter Young at LabSmart Services. Phone. 0432 767 706

13. Fax or e-mail the “Result Log” to LabSmart Services by 24 October 2018.

Fax: (03) 8888 4987 OR

E-mail: [email protected]

14. Please retain the completed “Results Log” as this contains your confidential

participation code. You will need this code to identify your results in the technical report covering the proficiency testing program. It is also recommended that a copy of completed worksheets be kept with the results log in your proficiency file.

15. Proficiency testing can also form part of a laboratories training records for the technician who performed the test.

Thank you for participating in this proficiency testing program.

Page 2 of 2

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 38 of 41

81 App B PT Results Log V4.docx

LabSmart Services

Proficiency Testing Program - California Bearing Ratio – 2018 (81)

RESULTS LOG for xxxx

Participation Code: xx

Please fax or e-mail the completed results log by 24 October 2018

E-mail: [email protected] or Fax: (03) 8888 4987

1. Please follow the instructions carefully.

2. Please describe the characteristics of the CBR machine used for the tests:

Date last calibrated

Calibrated range (I.e.0-50 kN)

Load Cell or Load Ring?

Calibration (Class A, B, C?)

Hand driven or motorised platform?

Rate of penetration: Average / Lowest / Highest?

Please complete the following regarding the performance of the test

➢ Condition of material as received

➢ Seating load used

➢ Has the seating load been set to zero? (Y/N)

➢ LL determined by Clause 5(d) (i), (ii) or (iii)

➢ LL value used

➢ Period cured for? (hours)

3. Please attach a copy of the CBR graph for test. 4. COMMENTS: (Please ensure all 5 sections are completed)

……………………………………………………………………………………………………………………………………………………………………………………………………………………

------------------------------------ ---------------------------------- --------------- Supervisor Name (Please Print) Signature Date

In signing the above, I acknowledge that the above results are approved and have been checked. I will also ensure that the results are kept confidential both internal and external to the laboratory until the issue of the final technical report covering this program.

Thank you for participating. Please retain these sheets for your records.

________________________________________________________________________

Have a query? Contact Peter on 0432 767 706. Page 1 of 2

Appendix B

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 39 of 41

81 App B PT Results Log V4.docx

5.

SAMPLE A Report

To Result

Test Method Used

Tested by: Name

Moisture (Clause 6[c]) (W1) (before compaction)

0.1 %

Moisture content variation (Wv) 0.1 %

Compaction Manual or Auto

Compaction Method Standard (Y/N)

Number of blows used per layer Number

Before Soaking

Dry density 0.001 g/cm3

Density Ratio (LDR)

0.1 %

Moisture Ratio (LMR)

0.1 %

BR @ 2.5 mm 0.1 %

BR @ 5.0 mm 0.1 %

Correction# 0.1 mm

Swell 0.1 %

After soaking

Moisture ww 0.1 %

Moisture w30 0.1 %

Moisture wr 0.1 %

# Enter zero if no correction is performed.

Please record the penetration/ load readings below (cross out and change if other

penetration values are used) OR attach worksheet for with penetration/load readings.

Penetration (mm)

Load (N)

Penetration

(mm) Load (N)

0 4.0

0.5 4.5

1.0 5.0

1.5 6.0

2.0 7.5

2.5 8.0

3.0 10.0

3.5 12.5

Page 2 of 2

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 40 of 41

Appendix C – Graph Example

Calculate correction line from: Correction = 1.1 mm

Lower = 3.0 mm BR @ 2.5 mm = 43.3 % Unrounded CBR = 57.5 %

Upper = 6.0 mm BR @ 5.0 mm = 57.5 % CBR = 60.0 %

y = 2.4169x4 - 68.849x3 + 604.68x2 + 196.34x - 20.964R² = 0.9999

02,0004,0006,0008,000

10,00012,00014,00016,00018,00020,00022,00024,00026,00028,00030,00032,00034,00036,00038,00040,00042,00044,000

0 1 2 3 4 5 6 7 8 9 10 11 12

Ap

plie

d L

oad

(N

)

Penetration (mm)

CBR Graph for Participant X

Data Values

Poly. (Data Values)

Correction

CBR Proficiency Testing Program - 2018(81)

Copyright: LabSmart Services Pty Ltd Issued - 29 January 2019 Page 41 of 41