Embed Size (px)
DESCRIPTION
Presented at the ACT Patriot Chapter conference in Boston, MA in June 2011.
Citation preview
1icfi.com |
COMPANY CONFIDENTIAL – NOT FOR COPYING OR DISTRIBUTION
Demonstrating Success & Accountability of TDM Programs through Operational Performance Measures and Reporting
Presented at 2011 New England Sustainable Transportation Summit
Frank MongioiSenior Manager, MBA
June 7, 2011
2icfi.com |
Overview
Purpose
Benefits
Case studies
Tools & calculations
Getting started
Questions & Answers
3icfi.com |
Purpose
What does success in TDM look like?
How effective are the results we are producing?
What are we learning from our results?
How can we put systems in place to ensure consistent measurement?
4icfi.com |
Why Evaluate TDM?
Accountability – are funders getting what they expect?
Regional policies – is TDM is supporting regional goals?
Benchmarking – how is program doing compared to peers?
Mission fulfillment – is program meeting stated goals?
Management – is program meeting internal performance objectives?
Transparency – is there clarity in decision making?
Synergy – does program support other transportation trends and vice versa?
5icfi.com |
Measuring your activities allows you to:
Assess your performance
Determine how to operate more efficiently
Identify gaps in services
Identify areas of success
Develop efficiencies
Recognize trends
Forecast results
6icfi.com |
Types of Performance MeasuresPerformance Measure
Purpose Example
Input Activity Measures
Shows quantitative data on the number of activities or efforts initiated by the program. Refers to actions or activities on the part of the program.
• Number of employer outreach events held • Number of presentations given• Number of brochures distributed• Number of calls made by sales staff to
businessesOutput Activity Measures
Shows quantitative data on the number of activities or results initiated by the customer or client, often in response to the program’s input activities. Refers to actions or activities on the part of the client or customer.
• Number of hotline calls received• Number of ride match applications received • Number of web hits online• Number of guaranteed ride home sign ups
Outcome Measures
Quantifies the results of the input and output activities. Often a result of extrapolating the input or output data.
• Single occupant vehicle (SOV) trips reduced• Parking spots saved• Vehicle miles traveled (VMT) reduced• Greenhouse gases reduced
Cost Effectiveness Measures
Associates a dollar amount with each input or output activity and each outcome measure to show the level of effort associated with each action. Sometimes a result of extrapolating the input, output or outcome data.
• Cost per rideshare application • Cost per employer sign up • Cost per VMT reduced• Cost per carpool formed
7icfi.com |
Categories of Measurement
Inputs: - Outreach- Marketing
Inputs Outputs / Direct Effects Outcomes
Cost Effectiveness
8icfi.com |
Why ROI Analysis?
Identifying efficiencies
Setting standards for performance measures and tracking
Sales pipeline, lead conversion and forecasting
9icfi.com |
Sample case studies
Arlington, VA
Tri-State Area
Clean Air NY
10icfi.com |
Arlington County Commuter Services, VA
Outlines TDM goals in the Arlington Master Transportation Plan
Established a performance evaluation plan
Develops tailored reports
11icfi.com |
Marketing by Demonstrating Results
Service Level Reports
Annual Report Card
Best Hits
Snapshots
12icfi.com |
New Jersey Statewide TMA Program
Each Transportation Management Association (TMA) creates its own work plan every two years with individual goals to report to the state.
TMAs collect information monthly and then submit reports to NJDOT each quarter.
NJDOT works with NJTRANSIT to establish performance indicators for the state.
13icfi.com |
Development of Strategic Plan
NJDOT is developing a TDM strategic plan that will formally define the department’s:
1) existing statewide TDM goals,
2) objectives, and
3) performance indicators.
The focus will be on linking department goals to evaluation metrics.
Status
14icfi.com |
Clean Air NY
Initiative sponsored by NYSDOT in support of downstate air-quality
Real-time updates on Air Quality Action Days via text message or e-mail
Outreach to employers, the public, campuses, community partners, etc.
15icfi.com |
NYSDOT Statewide
TDM Strategic Framework
– Develop a common vision for TDM in the state
– Minimize duplication across regions
– Share resources across regions
16icfi.com |
Developing performance measures
Development of standardized TDM indicators
Support trend analysis, comparisons, target setting, problem solving & design of effective solutions
Establish a foundation for measurement that reflects project development and goal achievement
17icfi.com |
Sample Calculations
18icfi.com |
Cost per sign up
$500 $50/hour $250
Staff Labor
Event Fees Materials
200 partner sign ups
Total Cost = $950
4 hour event
$4.75 per sign up
19icfi.com |
Cost per ridematch application
Develop consistent set of assumptions on costs related to:
• How many calls made to get a lead?
• How many leads needed to get a meeting?
• How many meetings needed to sign up a company?
• How many events held at a company?
• How many rideshare applications received at events?
Cost per Ridematch Application
20icfi.com |
Indicators
How many employees at the worksite?
– eg 1,000
How many attended the Commute Fair/event?
– eg 180 or 18%
Percentage of employees attending, who signed up?
– eg 40 or 22%
Cost/application?
– eg $400 / 40 apps = $10/ridematch application
21icfi.com |
External variables
Energy/gas prices
Economic
Transit enhancements
Environment, Climate Change
Other External Factors
22icfi.com |
Getting startedMake some assumptions
Be consistent
Put a system in place
Examine results annually
Tweak tracking methodologies when needed
Establish performance metrics or indicators
Identify a process for collection
Evaluate monthly, quarterly and annually
23icfi.com |
Tool Box: Return on Investment
• Keep track of performance metrics
# of partners
# of events attended
Event and staffing costs
• Ask yourself these questions
What is our cost per partner sign up?
What are our staffing needs?
How many partners should we expect to sign up?
Should we do this event again?
How should we modify our goals for next year?
24icfi.com |
Food for thought & challenges
Sign ups versus effectiveness of program
Moving towards national standards
Costs per VMT & SOV reduced
GHG reductions?
Other environmental measures?
