EVMP Forum – July 2014 2
The Goal Standardization Customization Recommendations for CAM analysis
◦ Filters and Views◦ Charts◦ Reports◦ Workspaces
Analyzing Significant Variances
Contents
EVMP Forum – July 2014 3
The Goal
EVMP Forum – July 2014 4
Make it easy to understand◦ Avoid EVM jargon
Make it easy to repeat on monthly basis◦ Give them a punch list◦ Desktop instructions, screen shots
Streamlined wscustom file Provide continual training Work one on one with them
The Goal for CAM Analysis
EVMP Forum – July 2014 5
Standardization
EVMP Forum – July 2014 6
Why standardize?◦ Allows for consistency across program and company◦ Allows for common communication
Use same views and charts for joint team meetings◦ Allows for joint validation of data
Custom filters for data integrity◦ Effective tool and framework for training◦ Saves a lot of time!!
Recommendation:◦ Save two versions of wscustom.xml on network
CAM: only what they need Analyst: more complete
◦ Have one person maintain wscustom.xml files
Standardization
EVMP Forum – July 2014 7
Customization
EVMP Forum – July 2014 8
Find out what CAMs need◦ “Dot” exercise◦ Ask them◦ What are they using now? What do they like?
Sit with PM or CAM and show them what is possible◦ Guide them through the roadmap◦ Suggest workspaces
Make it as easy as possible for everyone◦ They are not EV experts
Hints for Customization
EVMP Forum – July 2014 9
Ensure that the ProjOff field is correct◦ Allows filtering by CAM◦ Add custom field for work package manager
Use LongDesc field in views◦ Have IT change the registry key to show
LongDesc in reports and charts Use the Drill Down feature to isolate lower
level elements for a specific higher level element◦ Hold down the shift key while drilling down◦ Opens new window – easier to close out◦ Can be used to support variance analysis
Example: show WPs that sum to CA
Hints for Customization
EVMP Forum – July 2014 10
Drill Down Below Control Account
Apply sum buttonCan see significant contributors to variance at CA level
EVMP Forum – July 2014 11
Apply the CAM/IPT filter to isolate a CAM’s performance◦ Apply as a pre-filter◦ CAM can then apply different filters once the data is
open Create a filter for WP manager (if custom field
has been created) For data filtered by CAM:
◦ Apply the sum button and toggle to lowest level◦ Make the aggregate element the active element◦ Plot aggregate performance on charts and show in
reports
The CAM Filter
EVMP Forum – July 2014 12
Plotting Aggregate Performance
WBS DESCRIPTION Proj Ofcr %Comp %Spent CPI CV % CV VAC CV VAC
1 3200 COMMUNICATIONS Ti deman 34.63 41.03 0.844 -18.49 -130.8 -87.02 3300 AUX EQUIP Ti deman 27.57 24.33 1.133 11.73 78.2 8.43 (Aggregate)CAM=ti deman 30.80 31.98 0.963 -3.83 -52.6 -78.6
-40
-30
-20
-10
0
10
20
30
2007APR MAY JUN JUL AUG SEP OCT NOV DEC
2008JAN
Cumulative Variance PercentMEGA HERZ ELEC & VEN 1 OTHER OTHER Name: CAM=tideman Element: (Aggregate)
Pe
rce
nt
of
Do
lla
rs
COST -3.833.03-15.75-3.067.77-1.025.506.9611.3215.38SCHED -17.74-17.95-28.25-3.45-12.01-13.99-15.97-17.86-36.14-10.34VAC -1.76-2.21-2.19-7.95-7.95-7.95-7.22-7.22-7.22-7.22
EVMP Forum – July 2014 13
Aggregate Bull’s-Eye
-40
-30
-20
-10
0
10
20
30
40
-40 -30 -20 -10 0 10 20 30 40 50
Aggregate Bull's-eye ChartMOH-2 WBS JAN 08 Dollars
Filter (Lowest): ****All ElementsHighlight (Proj Ofcr): Tideman
BEHIND SCHEDULE, UNDER COST AHEAD OF SCHEDULE, UNDER COST
BEHIND SCHEDULE, OVER COST AHEAD OF SCHEDULE, OVER COST
SV% CUM Percent of Dollars
CV
% C
UM
Pe
rc
en
t o
f D
oll
ars
• Double click common element (CAM name) in Sort window
• Highlighted as red dots
EVMP Forum – July 2014 14
Apply CAM filter Click File, Save Workspace wInsight will automatically open to the
filtered data set for the CAM CAM can then apply additional filters to his
elements only
Default Workspace
EVMP Forum – July 2014 15
Recommendations for CAM AnalysisFilters and Views
EVMP Forum – July 2014 16
When Filter What it Does
Pre-filter CAM/IPT Filters for CAM’s elements
Pre-filter CAM/IPT wildcard Same as above, allows use of wildcard search, eg., Ba%. Useful for long or complicated names.
Filter Catch Planning Packages, with CAM
Filters for Planning Packages, with CAM filter (Use in conjunction with report, Catch Planning Packages
Filter EAC less than Cum CPI EAC
Filters for EAC where less than .9*Cum CPI EAC
Filter Early Significant Variances
Filters for elements less than 20% complete with significant variances
Filter Emerging Cost Problems
Filters for elements with RED or YELLOW for current period cost, but BLUE or GREEN for cum
Filter Emerging Schedule Problems
Filters for elements with RED or YELLOW for current period schedule, but BLUE or GREEN for cum
Filter VAR required by CAM?
Prompts for CAM name, filters on flagged variances
Filter ***EAC Realism Filters for elements where CPIcum differs from TCPI-EAC by greater than +/-.05
Best Filters for CAMs
EVMP Forum – July 2014 17
View What it Does
Cost Shows cost metrics (current and cum)
Schedule Shows schedule metrics (current and cum)
***EAC Realism Compares CPIcum to TCPI-EAC
Risk vs. Work Remaining
Shows risk rating, amount of budget vs. estimate remaining, EAC realism
BCWP Verification Used to verify that correct BCWP was reported
EAC Forecast Independent EAC calculations, compared to CAM’s EAC
Emerging Cost Problems
Shows current vs. cum cost metrics (use with filter with same name)
Emerging Schedule Problems
Shows current vs. cum schedule metrics (use with filter with same name)
Best Views for CAMs
18
Custom View - Costcompare compare
WBS DESCRIPTION Proj Ofcr %Comp %Spent CPI CV % CV VAC CV VAC
1 [MR] MGT RESERVE 0.00 0.00 0.000 0.00 0.0 439.2
2 5100 ENG DATA Novak 38.51 52.80 0.729 -37.10 -4.6 0.0
3 3200 COMMUNICATIONS Tideman 34.63 41.03 0.844 -18.49 -130.8 -87.0
4 3600 PCC Zepka 28.99 34.09 0.850 -17.62 -296.2 -187.2
5 5200 MANAGEMENT DATA Simmons 84.18 98.10 0.858 -16.54 -13.2 -16.0
6 2200 SYS ENGINEERING Price 85.04 94.35 0.901 -10.95 -26.4 0.0
7 [G&A] GEN & ADMIN 33.67 36.11 0.932 -7.26 -45.2 -36.8
8 2100 PROJ MANAGEMENT Brown 45.70 48.51 0.942 -6.16 -17.4 -3.2
9 4000 SPARES Blair 17.87 18.90 0.945 -5.78 -7.8 -6.2
10 2300 FUNC INTEGRA Price 71.62 75.23 0.952 -5.03 -17.4 -30.8
11 3800 I & A Troop 35.40 37.08 0.955 -4.75 -24.2 -24.8
12 3100 SENSORS Smith 20.87 21.49 0.971 -2.94 -10.6 -21.6
CAMs: Apply CAM/IPT filter to isolate elements
EVMP Forum – July 2014 19
Custom View - Schedule
Budgeted Cost of Work Remainingindicates amount of work yet to go
compare
DESCRIPTION LL Proj Officer SV SV SV % SPI % Comp % Sched BCWR
1 COMMUNICATIONS Tideman -203.2 -22.31 0.777 34.63 44.57 1,335.6
2 DATA DISPLAY Troop -113.0 -41.45 0.585 41.13 70.26 228.4
3 AUX EQUIP Tideman -93.2 -12.27 0.877 27.57 31.42 1,751.6
4 GEN & ADMIN -39.0 -5.89 0.941 33.67 35.78 1,227.4
5 SENSORS Smith -36.6 -9.21 0.908 20.87 22.99 1,367.6
6 PROJ MANAGEMENT Brown -12.0 -4.07 0.959 45.70 47.64 335.8
7 PCC Zepka -11.4 -0.67 0.993 28.99 29.18 4,119.2
8 ADPE Zepka -10.2 -3.91 0.961 41.89 43.59 348.2
9 FUNC INTEGRA Price -7.6 -2.15 0.978 71.62 73.20 137.0
10 ENG DATA Novak -6.6 -34.74 0.653 38.51 59.01 19.8
11 TEST FACILITIES Smart -0.6 -0.59 0.994 100.00 100.59 0.0
12 COMP PROGRAMS Pino -0.2 -0.23 0.998 46.46 46.56 101.2
CAMs: Apply CAM/IPT filter to isolate elements
20
BCWP Verification
Apply BCWP Verification view at lowest level Apply CAM/IPT filter if desired Provide to CAM and IPT leader
◦ Ask them to correlate the reported current and cum BCWP with the technical status
WBS Number LVL Description BCWS Cur BCWP Cur BCWS BCWP % Compl BCWR BAC
1 3600 3 PCC 442.8 438.8 1,692.8 1,681.4 28.99 4,119.2 5,800.6
2 3300 3 AUX EQUIP 159.4 129.4 759.8 666.6 27.57 1,751.6 2,418.2
3 3100 3 SENSORS 153.0 140.2 397.4 360.8 20.87 1,367.6 1,728.4
4 3200 3 COMMUNICATIONS 199.4 168.4 910.6 707.4 34.63 1,335.6 2,043.0
5 [G&A] 2 GEN & ADMIN 149.6 137.2 662.0 623.0 33.67 1,227.4 1,850.4
EVMP Forum – July 2014 21
Emerging Cost and Schedule Problems
Custom filters and views
EVMP Forum – July 2014 22
Recommendations for CAM AnalysisCharts
EVMP Forum – July 2014 23
Chart What it Does
Cumulative Variance ($, %)
Shows cum data trend lines (CV, SV, VAC) by either $ or %(good for trend analysis and forecasting)
Current Variance ($, %)
Shows current data lines (CV, SV) by either $ or % (good for spotting problems in current period, sudden shifts)
CPI and SPI Shows past trend lines for cost and schedule efficiencies
Cumulative Element Performance
Shows past performance data plus future
EAC Shows total BAC, EAC, and Cum CPI EAC
IEACs vs. Ctr EAC column
Compares three calculated EACs to CAM’s EAC
Best Charts for CAMs
EVMP Forum – July 2014 24
Charts for Evaluating Performance
-40
-30
-20
-10
0
10
20
2007APR MAY JUN JUL AUG SEP OCT NOV DEC
2008JAN
Cumulative Variance PercentMEGA HERZ ELEC & VEN 1 OTHER OTHER Name: PCC Element: 3600
Pe
rce
nt
of
Do
lla
rs
COST -17.62-23.32-36.45-26.08-12.79-23.08-15.91-14.40-10.170.00SCHED -0.67-0.590.7214.494.382.20-0.90-4.58-24.363.57VAC -3.23-3.37-3.37-6.36-6.36-6.36-5.64-5.64-5.64-5.64
Cumulative Variance Percent
0.750
0.800
0.850
0.900
0.950
1.000
1.050
1.100
1.150
2007APR MAY JUN JUL AUG SEP OCT NOV DEC
2008JAN
CPI and SPIMEGA HERZ ELEC & VEN 1 OTHER OTHER Name: PCC Element: 3600
In
de
x o
f D
oll
ars
SPI 0.9930.9941.0071.1451.0441.0220.9910.9540.7561.036CPI 0.8500.8110.7330.7930.8870.8130.8630.8740.9081.000
CPI and SPI
EVMP Forum – July 2014 25
Charts for Checking EAC Realism
5.00
5.50
6.00
6.50
7.00
7.50
8.00
2007APR MAY JUN JUL AUG SEP OCT NOV DEC
2008JAN
IEACs vs. Ctr EAC columnMEGA HERZ ELEC & VEN 1 OTHER OTHER Name: PCC Element: 3600
Do
lla
rs
in
Mil
lio
ns
CPI EAC 6.8226.8417.5696.4845.8016.3305.9615.8845.6665.143WtdCostSch 6.4476.3026.5555.4565.3765.6535.5665.6326.1755.053CPI * SPI 6.8556.8737.5235.7675.5826.2026.0136.1597.4704.967EAC 5.9885.7345.7345.4705.4705.4705.4335.4335.4335.433
5.25
5.50
5.75
6.00
6.25
6.50
6.75
7.00
7.25
7.50
7.75
2007APR MAY JUN JUL AUG SEP OCT NOV DEC
2008JAN
Estimates at CompletionMEGA HERZ ELEC & VEN 1 OTHER OTHER Name: PCC Element: 3600
Do
lla
rs
in
Mil
lio
ns
BAC 5.8015.5475.5475.1435.1435.1435.1435.1435.1435.143LRE 5.9885.7345.7345.4705.4705.4705.4335.4335.4335.433C UM C PI 6.8226.8417.5696.4845.8016.3305.9615.8845.6665.143
EAC
IEACs vs. Ctr EAC column
EVMP Forum – July 2014 26
Recommendations for CAM AnalysisReports
EVMP Forum – July 2014 27
Report What it Does
CAM Report Performance data, with color trends. Future BCWS vs. ETC
Color Trends Color trends (data value, color, arrow) for past twelve months
EAC Realism Shows 4 checks of EAC realism, with narrative
Six Period Summary
Tabular data (current, cum, at complete, range of calculated EACs)
AI Narrative Assists with interpretation of data
Banded Validity Performs 25 validity checks on data. (Filter for CAM)
Best Reports for CAMs
Custom ReportCAM Report
CAM Report
(based on color threshold code written by Mitch Mueller, LM)
28
Toggle between $ and hours
Custom ReportColor Trends
Color Trends
(based on color threshold code written by Mitch Mueller, LM)
29
Weights for Cost + Schedule Forecast: Cost = 50.0% Schedule = 50.0% Forecasts are summed from lower levels.
Notes
Evaluate the EAC against the linear regression formula. Note that this is not a curvilinear function, but a straight line projection.
28,643.9Linear Regression
28,389.4Contractor's EAC
Method 4 - Compare EAC to Regression Forecasts
Compare the EAC to range of statistical EACs.If the EAC is below the range, it appears to be unrealistic based on past performance.If the EAC is within the range, it appears to be realistic based on past performance, but evaluate its position within the range.If the EAC is above the range, it may be too pessimistic, unless it is based on knowledge of future risks.Compare the EAC to the range of User EACs (if input).
28,389.0SPO EAC
30,169.8•User EAC (max)
29,580.8•User EAC (most likely)
28,663.8•User EAC (min)
User Input EACs
28,696.0•CPI*SPI
28,600.9•MICOM (CPI6*SPI)
28,525.8•Weighted Cost Schedule
28,512.7•Cumulative CPI
28,414.7•CPI (6 period average)
27,167.8•CPI (3 period average)
30,874.7•Current Period CPI
wInsight Independent Statistical Forecasts
28,389.4Contractor's EAC
Method 3 - Compare EAC to Statistical Forecasts
The EAC is relatively consistent with cost efficiency to date.
-0.007Comparison of CPI to TCPI-EAC
1.002TCPI-EAC
0.995CPI
Method 2 - Comparison of CPI to TCPI-EAC
The cumulative cost variance to date is worse than the projected final cost overrun. The EAC appears to be optimistic or may be outdated.Cumulative cost performance is overrunning; but final costs are expected to come in at the budget value.
0.0VAC
-36.0Cum Cost Variance
Method 1 - Comparison of CV to VAC
Element Code: 1000Element Name: MOH-2
As of: JAN 04Contract Name: MOH-2Contract Number: F04695-86-C-0050Contractor: MEGA HERZ ELEC & VEN
Project Officer: JonesOffice Symbol: JDHD
EAC Realism - Work Breakdown Structure (Dollars)
Weights for Cost + Schedule Forecast: Cost = 50.0% Schedule = 50.0% Forecasts are summed from lower levels.
Notes
Evaluate the EAC against the linear regression formula. Note that this is not a curvilinear function, but a straight line projection.
28,643.9Linear Regression
28,389.4Contractor's EAC
Method 4 - Compare EAC to Regression Forecasts
Compare the EAC to range of statistical EACs.If the EAC is below the range, it appears to be unrealistic based on past performance.If the EAC is within the range, it appears to be realistic based on past performance, but evaluate its position within the range.If the EAC is above the range, it may be too pessimistic, unless it is based on knowledge of future risks.Compare the EAC to the range of User EACs (if input).
28,389.0SPO EAC
30,169.8•User EAC (max)
29,580.8•User EAC (most likely)
28,663.8•User EAC (min)
User Input EACs
28,696.0•CPI*SPI
28,600.9•MICOM (CPI6*SPI)
28,525.8•Weighted Cost Schedule
28,512.7•Cumulative CPI
28,414.7•CPI (6 period average)
27,167.8•CPI (3 period average)
30,874.7•Current Period CPI
wInsight Independent Statistical Forecasts
28,389.4Contractor's EAC
Method 3 - Compare EAC to Statistical Forecasts
The EAC is relatively consistent with cost efficiency to date.
-0.007Comparison of CPI to TCPI-EAC
1.002TCPI-EAC
0.995CPI
Method 2 - Comparison of CPI to TCPI-EAC
The cumulative cost variance to date is worse than the projected final cost overrun. The EAC appears to be optimistic or may be outdated.Cumulative cost performance is overrunning; but final costs are expected to come in at the budget value.
0.0VAC
-36.0Cum Cost Variance
Method 1 - Comparison of CV to VAC
Element Code: 1000Element Name: MOH-2
As of: JAN 04Contract Name: MOH-2Contract Number: F04695-86-C-0050Contractor: MEGA HERZ ELEC & VEN
Project Officer: JonesOffice Symbol: JDHD
EAC Realism - Work Breakdown Structure (Dollars)
Weights for Cost + Schedule Forecast: Cost = 50.0% Schedule = 50.0% Forecasts are summed from lower levels.
Notes
Evaluate the EAC against the linear regression formula. Note that this is not a curvilinear function, but a straight line projection.
28,643.9Linear Regression
28,389.4Contractor's EAC
Method 4 - Compare EAC to Regression Forecasts
Compare the EAC to range of statistical EACs.If the EAC is below the range, it appears to be unrealistic based on past performance.If the EAC is within the range, it appears to be realistic based on past performance, but evaluate its position within the range.If the EAC is above the range, it may be too pessimistic, unless it is based on knowledge of future risks.Compare the EAC to the range of User EACs (if input).
28,389.0SPO EAC
30,169.8•User EAC (max)
29,580.8•User EAC (most likely)
28,663.8•User EAC (min)
User Input EACs
28,696.0•CPI*SPI
28,600.9•MICOM (CPI6*SPI)
28,525.8•Weighted Cost Schedule
28,512.7•Cumulative CPI
28,414.7•CPI (6 period average)
27,167.8•CPI (3 period average)
30,874.7•Current Period CPI
wInsight Independent Statistical Forecasts
28,389.4Contractor's EAC
Method 3 - Compare EAC to Statistical Forecasts
The EAC is relatively consistent with cost efficiency to date.
-0.007Comparison of CPI to TCPI-EAC
1.002TCPI-EAC
0.995CPI
Method 2 - Comparison of CPI to TCPI-EAC
The cumulative cost variance to date is worse than the projected final cost overrun. The EAC appears to be optimistic or may be outdated.Cumulative cost performance is overrunning; but final costs are expected to come in at the budget value.
0.0VAC
-36.0Cum Cost Variance
Method 1 - Comparison of CV to VAC
Element Code: 1000Element Name: MOH-2
As of: JAN 04Contract Name: MOH-2Contract Number: F04695-86-C-0050Contractor: MEGA HERZ ELEC & VEN
Project Officer: JonesOffice Symbol: JDHD
EAC Realism - Work Breakdown Structure (Dollars)
Weights for Cost + Schedule Forecast: Cost = 50.0% Schedule = 50.0% Forecasts are summed from lower levels.
Notes
Evaluate the EAC against the linear regression formula. Note that this is not a curvilinear function, but a straight line projection.
28,643.9Linear Regression
28,389.4Contractor's EAC
Method 4 - Compare EAC to Regression Forecasts
Compare the EAC to range of statistical EACs.If the EAC is below the range, it appears to be unrealistic based on past performance.If the EAC is within the range, it appears to be realistic based on past performance, but evaluate its position within the range.If the EAC is above the range, it may be too pessimistic, unless it is based on knowledge of future risks.Compare the EAC to the range of User EACs (if input).
28,389.0SPO EAC
30,169.8•User EAC (max)
29,580.8•User EAC (most likely)
28,663.8•User EAC (min)
User Input EACs
28,696.0•CPI*SPI
28,600.9•MICOM (CPI6*SPI)
28,525.8•Weighted Cost Schedule
28,512.7•Cumulative CPI
28,414.7•CPI (6 period average)
27,167.8•CPI (3 period average)
30,874.7•Current Period CPI
wInsight Independent Statistical Forecasts
28,389.4Contractor's EAC
Method 3 - Compare EAC to Statistical Forecasts
The EAC is relatively consistent with cost efficiency to date.
-0.007Comparison of CPI to TCPI-EAC
1.002TCPI-EAC
0.995CPI
Method 2 - Comparison of CPI to TCPI-EAC
The cumulative cost variance to date is worse than the projected final cost overrun. The EAC appears to be optimistic or may be outdated.Cumulative cost performance is overrunning; but final costs are expected to come in at the budget value.
0.0VAC
-36.0Cum Cost Variance
Method 1 - Comparison of CV to VAC
Element Code: 1000Element Name: MOH-2
As of: JAN 04Contract Name: MOH-2Contract Number: F04695-86-C-0050Contractor: MEGA HERZ ELEC & VEN
Project Officer: JonesOffice Symbol: JDHD
EAC Realism - Work Breakdown Structure (Dollars)
30
EAC Realism Report
EVMP Forum – July 2014 31
Banded Validity
Author: Mitch Mueller, LMCO
EVMP Forum – July 2014 32
Recommendations for CAM AnalysisWorkspaces
EVMP Forum – July 2014 33
WorkspacePast PerformanceFuture PerformanceVAR Input
CAM Dashboard
Best Workspaces for CAMs
EVMP Forum – July 2014 34
Workspace – Past Performance
EVMP Forum – July 2014 35
Workspace – Future Performance
EVMP Forum – July 2014 36
Workspace – VAR Input
EVMP Forum – July 2014 37
Workspace – CAM Dashboard
“Punch list”Maximum each in turn
EVMP Forum – July 2014 38
Analyzing Significant Variances
Analyzing Individual Elements
39
1. Double click to make it Active Element
2. Standard sort window Is it a significant cost or schedule driver? Look at trends (arrows) Compare colors for SV, CV, VAC
3. Evaluate trends on charts Cum and Current Variance ($ and %) CPI and SPI Evaluate BAC/EAC changes on EAC chart
4. Review reports Validity Report AI Report Six Period Summary Report CAM Report Color Trends Report
5. Analyze schedule metrics Apply Schedule view Apply Emerging Schedule Problems
view Open SPI chart and analyze trends Open Schedule Analysis report Evaluate trends and compare to network
schedule
6. Analyze cost metrics Apply Cost view Apply Emerging Cost Problems view Open CPI chart and analyze trends Evaluate monthly burn rate on Six Period Summary Report
7. Integrate analysis of cost and schedule trends Customer: Read Format 5 Contractor: Perform root cause analysis
8. Analyze contractor’s EAC for realism Apply ***EAC Realism view
Compare CV, VAC color trends Evaluate EAC Realism field
Open IEACs vs. Ctr’s EAC column chart Review EAC Realism custom report
9. Project future performance Apply Risk vs. Work Remaining view Generate EAC or range of EACs Project schedule dates (use IMS)
10. Input Format 5 or User Narrative
11. Discuss with PM and IPT lead
EVMP Forum – July 2014 40
Provide the right information to the CAMs◦ But don’t overwhelm◦ Provide guidance, roadmap, punch list, desktop
instruction◦ Meet their needs
Presentation available:◦ www.winsight.weebly.com/winsight-resources.htm
Custom reports and wscustom.xml available:◦ www.earnedvalue.biz
wInsight Resources wInsight Custom Reports
In conclusion..
EVMP Forum – July 2014 41
If you build it, they will come