11
Lessons Learned* Lessons Learned* from PPIN from PPIN Evaluation Evaluation The Fine Print: The Fine Print: 1) Not a random sample. 1) Not a random sample. 2) May not be representative of all P2Rx 2) May not be representative of all P2Rx users. users. * * The survey audience and respondent sample is The survey audience and respondent sample is uncertain. uncertain.

Lessons Learned* from PPIN Evaluation

  • Upload
    lis

  • View
    24

  • Download
    0

Embed Size (px)

DESCRIPTION

Lessons Learned* from PPIN Evaluation. The Fine Print: 1) Not a random sample. 2) May not be representative of all P2Rx users. * The survey audience and respondent sample is uncertain. How Users Find Us. - PowerPoint PPT Presentation

Citation preview

Page 1: Lessons Learned* from PPIN Evaluation

Lessons Learned*Lessons Learned*from PPIN Evaluationfrom PPIN EvaluationThe Fine Print: The Fine Print: 1) Not a random sample.1) Not a random sample.2) May not be representative of all P2Rx 2) May not be representative of all P2Rx

users.users.**The survey audience and respondent sample is The survey audience and respondent sample is

uncertain.uncertain.

Page 2: Lessons Learned* from PPIN Evaluation

How Users Find UsHow Users Find Us

(Beats out assistance program, brochure or newsletter, link from (Beats out assistance program, brochure or newsletter, link from another website, search engine, vendor and other.)another website, search engine, vendor and other.)

0%

5%

10%

15%

20%

25%

30%

35%

40%

Meeting Colleague e-mailBusiness

TAP

Page 3: Lessons Learned* from PPIN Evaluation

Usefulness of SiteUsefulness of Site

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Business TAP

Increased Awareness ofEnvironmental Practices

Improved Ability toProvide Tech Assist

Page 4: Lessons Learned* from PPIN Evaluation

Top Rated ResourcesTop Rated Resources

Sum of responses: useful + very usefulSum of responses: useful + very useful

0%

20%

40%

60%

80%

100%

Topic

Hubs

P2 Progra

ms Dire

ctory

News

Secto

r Reso

urces

Case St

udies

Listse

rv

Librar

y

Business

TAP

Page 5: Lessons Learned* from PPIN Evaluation

How Websites are Used:How Websites are Used:

0%

10%

20%

30%

40%

50%

60%

Training ormeeting

Used Topic Hubor other info

Provided infoto others

BusinessTAP

Page 6: Lessons Learned* from PPIN Evaluation

Actions TakenActions Taken

About About 70%70% (of 376 respondents) (of 376 respondents)report taking some action to report taking some action to improve improve environmental practicesenvironmental practices. .

About About 25%25% (of 443 respondents) (of 443 respondents) agreed that P2Rx or the actions taken agreed that P2Rx or the actions taken resulted in resulted in cost savings cost savings (time and (time and dollars) to dollars) to themthem..

49%49% of the 221 TAPs agreed that using of the 221 TAPs agreed that using P2Rx had resulted in P2Rx had resulted in cost savings cost savings to to their their clientsclients..

Page 7: Lessons Learned* from PPIN Evaluation

**Difference in Use Based on ClientDifference in Use Based on Client

State programs State programs and and wastewater wastewater

treatment treatment programs use P2Rx info to programs use P2Rx info to

provide info to their clients.provide info to their clients.

Businesses, Local governments, Businesses, Local governments,

educational institutionseducational institutions, ,

andand non-profitsnon-profits use use

P2Rx info for their P2Rx info for their

own organizations.own organizations.*Based on EPA analysis of survey data*Based on EPA analysis of survey data

Page 8: Lessons Learned* from PPIN Evaluation

*Frequency of Use & Outcomes*Frequency of Use & Outcomes StatesStates are more likely to use P2Rx weekly (than are more likely to use P2Rx weekly (than

expected by chance). expected by chance).

Local governments Local governments use P2Rx sporadically (less use P2Rx sporadically (less often than every 3 months)often than every 3 months)

There is a significant correlation There is a significant correlation between frequency of use between frequency of use and endorsement that and endorsement that P2Rx improves awareness.P2Rx improves awareness.

*Based on EPA analysis of survey data*Based on EPA analysis of survey data

Page 9: Lessons Learned* from PPIN Evaluation

*Actions Taken*Actions Taken““The most thrilling statement of your The most thrilling statement of your

program’s effectiveness is that the program’s effectiveness is that the preponderance of the intermediate outcome preponderance of the intermediate outcome measures on Q8 and Q9 are significantly measures on Q8 and Q9 are significantly correlated with frequency of use of P2Rx.”correlated with frequency of use of P2Rx.”

——EPA statisticianEPA statistician

Those who use the program most Those who use the program most

frequently are more likely to report frequently are more likely to report

behavioral changesbehavioral changes..

*Based on EPA analysis of survey data*Based on EPA analysis of survey data

Page 10: Lessons Learned* from PPIN Evaluation

What’s Left to Do?What’s Left to Do?

Document these Outcomes: Document these Outcomes:

For TAPsFor TAPs: :

Improvements in information content, delivery, sharingImprovements in information content, delivery, sharing

Increased capacity to provide P2 servicesIncreased capacity to provide P2 services

Efficient, high quality P2 assistance providedEfficient, high quality P2 assistance provided

For End usersFor End users::

Increased awareness of P2Increased awareness of P2

Implementation of P2 practices Implementation of P2 practices

Reduced use of: energy, water and other resourcesReduced use of: energy, water and other resources

Reduced wasteReduced waste

Page 11: Lessons Learned* from PPIN Evaluation

Specifically – We Need to:Specifically – We Need to:

1.1. Identify web site users (TAP or end-user).Identify web site users (TAP or end-user).

2.2. Ask if the web site increases awareness or Ask if the web site increases awareness or

capacity.capacity.

3.3. Use uniform (or common) questions by all Use uniform (or common) questions by all

centers to measure short-term and intermediate centers to measure short-term and intermediate

outcomes.outcomes.

4.4. Measure outcomes for all “identified” Measure outcomes for all “identified”

users users (we have their contact information (we have their contact information

or use advisory groups).or use advisory groups).