18
1 1 The Evolution of Evaluation What Gets Measured is What Counts

1 1 The Evolution of Evaluation What Gets Measured is What Counts

Embed Size (px)

Citation preview

Page 1: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

11

The Evolution of Evaluation

What Gets Measured is What Counts

Page 2: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

2

Chris FosterVice President Strategy & Organization Booz I Allen I Hamilton

Page 3: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

3

• The C-suite executives expect metrics and prefers those of outcome-oriented persuasion

• Although PR practitioners note that engagement is a best practice, most still rely on impressions as evidence of impact

• Measures must move beyond mere impressions (outputs) to understanding comprehension of message (outtakes), and ultimately, to understanding how the message impacted the target audience’s attitudes and emotions (outcomes).

Communications Measurement is Seen as an Add-On

“You have to move beyond the obvious metrics such as media impressions, Facebook "likes" and Twitter followers. Those can provide a clue to your reach. If you really want to show your effectiveness, you need to decide what needle you want to move—sales, fundraising activity or advocacy reach, for example—and then measure your media activity against that.”

- Laura Howe, VP, public relations at the American Red Cross

Communicating with the C-suite

Page 4: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

• We need metrics that support business decisions

• Web metrics such as sentiments and perceptions are most effective measures of digital media impact

• Economy has had a negative effect on communications and measurement budgets

• We need much deeper understanding of communications measurement best practices

• Greatest need is for a common ROI definition

• We need standard metrics for ROI and communications effectiveness

• We need metrics that support business decisions

• Web metrics such as sentiments and perceptions are most effective measures of digital media impact

• Economy has had a negative effect on communications and measurement budgets

• We need much deeper understanding of communications measurement best practices

• Greatest need is for a common ROI definition

• We need standard metrics for ROI and communications effectiveness

Similarities Across Markets (Global Survey Results)

Page 5: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

5

October 2012 Research Results

Page 6: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

6

What are the biggest challenges to measuring the value of public relations?

Page 7: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

7

What do you believe are the greatest barriers to the adoption of standardized research techniques for the measurement of public relations?

Page 8: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

8

On a scale of 0 to 10, where “0” is unimportant and “10” is important, how important is it the

following are well understood across the public relations profession in the next five years?

Incidence of “Very” and “Somewhat Important” RatingIncidence of “Very” and “Somewhat Important” Rating

Base: All respondentsn=57

Base: All respondentsn=57

8

Importance of PR MeasuresImportance of PR Measures

Page 9: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

9

On a scale of 0 to 10, where “0” is unimportant and “10” is important, how important is it the

following are well understood across the public relations profession in the next five years?

Incidence of “Very” and “Somewhat Important” RatingIncidence of “Very” and “Somewhat Important” Rating

Base: All respondentsn=57

Base: All respondentsn=57

9

Importance of PR MeasuresImportance of PR Measures

Page 10: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

10

How much do you agree or disagree with the following statements, where “5” is “strongly agree”

and “1” is “strongly disagree”?

Incidence of “Strongly” and “Somewhat Agree” RatingIncidence of “Strongly” and “Somewhat Agree” Rating

Base: All respondentsn=57

Base: All respondentsn=57

10

Attribute AssessmentAttribute Assessment

Page 11: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

11

What are the challenges/barriers to measurement that you encounter? Below are statements about

barriers to measuring communications that you may or may not agree with or hear most commonly

from clients. Using the scale where “0” means you completely disagree with that statement and a

“10” means you completely agree with that statement, please rate each of the following.

Incidence of “Very” and “Somewhat Agree” RatingIncidence of “Very” and “Somewhat Agree” Rating

Base: All respondentsn=57

Base: All respondentsn=57

11

Challenges / Barriers to MeasurementChallenges / Barriers to Measurement

Page 12: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

12

Below is a list of metrics that may be used to measure the impact of digital media. Based on your

experience or by what you read and hear, which one do you consider most effective?

Base: All respondentsn=57

Base: All respondentsn=57

12

Digital Media Impact MetricsDigital Media Impact Metrics

Page 13: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

13

On a scale of 0 to 10, where “0” is unimportant and “10” is important, how important are each of the

following competencies for a public relations professional?

Incidence of “Very” and “Somewhat Important” RatingIncidence of “Very” and “Somewhat Important” Rating

Base: Public Relations Professionalsn=47

Base: Public Relations Professionalsn=47

13

Importance of CompetenciesImportance of Competencies Public Relations Professionals

Page 14: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

14

On a scale of 0 to 10, where “0” is unimportant and “10” is important, how important are each of the

following competencies for a public relations professional?

Incidence of “Very” and “Somewhat Important” RatingIncidence of “Very” and “Somewhat Important” Rating

Base: Public Relations Professionalsn=47

Base: Public Relations Professionalsn=47

14

Importance of CompetenciesImportance of Competencies Public Relations Professionals

Page 15: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

15

During the past three years, what impact, if any, has the economy had on your organization’s

overall communications budget?

Base: All respondentsn=57

Base: All respondentsn=57

Net:Positive effect 7%Negative effect 60%

Net:Positive effect 7%Negative effect 60%

15

Effect of Economy on Communications BudgetEffect of Economy on Communications Budget

Page 16: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

16

Key Findings

• Practitioners see many challenges to measuring the value of PR and implementing measurement into standard practice. Limitations on staff, time, budgets and a general lack of understanding of measurement principles contribute to this challenge.

• In the past three years, the economy has had a negative effect on communications and measurement budgets, limiting resources while simultaneously increasing the importance to show the value in our work for clients.

• Within five years, over 90% of surveyed public relations professionals indicated a need for the development of communication measurement standards and practices.

• A desire for more effective measurement creates a need for measuring ROI and capturing true business impact.

Page 17: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

17

Solution

As an industry, we need to:

•Change the way we communicate and present our value

•Incorporate measurement in our missions and objectives

•Use research-driven data to demonstrate the value that

strategic communications delivers in a way that can be

universally understood and embraced by budgets across the

globe

Page 18: 1 1 The Evolution of Evaluation What Gets Measured is What Counts

18

As an industry, we have a shared responsibility to:

•Reframe how we talk about measurement and communications and the value of communications and PR•Seize opportunities to gain more understanding in measurement and identify how to implement into practice•Utilize communication as a tool in problem solving•Meet the demand for data-driven campaigns

Call to Action