Upload
james-dickerson
View
214
Download
0
Tags:
Embed Size (px)
Citation preview
April 19, 2023 1
Coherence, Effectiveness, Relevance:Staff Survey Results for COUNTRY
Presentation of Staff Survey ResultsGENERIC TEMPLATE
NOTE:1. This tool/guidance has been developed based on the experiences of the DaO Pilot countries. 2. External team to present staff survey results to UNCT.
•Introduction – Survey purpose and response rates
•Results 1 – Staff understanding of and views on CER
•Results 2 – Assessment of “building blocks for change”
•Discussion – Review of key findings and identification of actions to take
•Appendix
PRESENTATION OUTLINE
2
3
BACKGROUND AND PURPOSES OF SURVEY
•The Staff Survey intended to gather opinions from all UN staff on the progress, challenges and key staff issues related to CER in COUNTRY
•Specific purposes:–….
4
SURVEY FORMAT AND RESPONSE RATE
Source: Staff Survey
• Survey structured to investigate two broad issues:– Understanding of, support for and views of progress on CER– Extent to which key “building blocks of change” for staff are in place
• Survey instrument:– Three variations of the survey – full version (xx multiple choice questions,
a open response questions), short version for staff spending less than 10% of their time on CER (yy multiple choice questions, b open response questions), HoA version (zz multiple choice questions, c open response questions)
– Survey offered online with option to complete paper version– Available in English and LANGUAGE (short version only)– Survey open from DATE to DATE
• Response rate:– XXX respondents (approx. A%) started the survey proper [excluding 40
respondents who left the survey within the first three questions]– YYY respondents (approx. B%) completed all questions; fall off in
responses was gradual throughout the survey– Generally good distribution of responses
DEMOGRAPHICS: For which UN organisation do you work?
4
25
79
1
3
28
18
70
11
7
9
5
4
20
10Agency 1
Agency 2
Agency 3
Agency 4
Agency 5
Agency 6
Agency 7
Agency 8
Agency 9
Agency 10
Agency 11
Agency 12
Agency 13
Agency 14
Agency 15
Responses by UN Organization/Unit will be shown
Responses by UN Organization/Unit will not be shown because of lack of critical size
Note: N = XSource: Staff Survey
5
Number of Responses by UN Organisation/Unit
5%
Other
5%Intern (including UNV intern)
5%UN Volunteer (International and National)
5%Consultant (Special Service Agreement,
Service Contract, etc)
G4-G7 20%
G1-G320%
National Officer20%
Internationally recruited
20%
6
DEMOGRAPHICS: What type of contract do you hold?
N = 100Source: Staff Survey April 2008Source: Staff Survey
7
DEMOGRAPHICS: gender, location, area, time
50% Female50%Male45% Programmes
45%Operations
Head of Agency
10%
5%
90%
Capital City
5%
Other location in COUNTRY Outside COUNTRY
25%
0%-10%
50%> 10%
25%
0%
By Gender (N = 100) By Primary Area of Work (N = 100)
By Location (N = 100)By Amount of time spent on CER (N = 100)
Source: Staff Survey
8
IMPACT ON DAY-TO-DAY WORK
20%
Significant parts of my job are done differently
20%I do some things differently every day
20%My job is different in minor ways
My job has not changed at all
20%
My job is completely related to CER
20%
20%
20%
My job will be different in minor ways
10%
I expect to do some things differently every day
My job will completely change due to CER
20%Significant parts of my job will be done differently
20%
My job will not change at all
10%
Don’t know
How much has your job changed already because of CER?
How much (further) do you expect your job to change because of CER?
Occurred change (N = 100)
Expected change (N = 100)
Source: Staff Survey
•Introduction – Survey purpose and response rates
•Results 1 – Staff understanding of and views on the CER Initiative– Understanding of and vision for CER– Effectiveness of communications– Belief and support for CER– Views on progress of CER– Views on most obstacles and actions needed
•Results 2 – Assessment of “building blocks for change”
•Discussion – Review of key findings and identification of actions to take
•Appendix
PRESENTATION OUTLINE
NOTE:Yellow boxes will mark interesting findings, not necessarily requiring
action
NOTE:Red boxes will mark important
findings, that may indicate required action
9
10
UNDERSTANDING OF CER: What is your vision for the UN in country in 2010?
Open response question, N = 200 Source: Staff Survey April 2008
20%A
10%B
10%C
10%D
10%E
5%F
5%
Other
Source: Staff Survey
Most commonly cited visions are A and B
11
AA
EE
“….”
“….” “….”
“….”
“….”
“….”
“….”
“….”
“….”
BB
CC
DD
FF
“….”
“….”
“….”
Source: Staff Survey
UNDERSTANDING OF CER: What is your vision for the UN in country in 2010 …? [sample quotes from open responses]
12
COMMUNICATION: Overall ratings of current communications.
Source: Staff Survey April 2008
4,00*I am receiving the information I need regarding the current status and the next steps being taken on the CER Initiative in country (N=330)
3,00**I see the UN speaking with One Voice externally in country through coordinated communications and advocacy efforts (N=145, Don't know=8)
3,00**I feel there is sufficient level of communication about the CER Initiative to outside stakeholders (N=125, Don't know=12)
1 2 3 4 5
* Not asked in HoA version** Only asked in full version of surveySource: Staff Survey
Survey questionsStrongly disagree
Strongly agree
More positive about internal communications than external
communications.
13
Understanding of CERUnderstanding of CER
Belief and supportBelief and support
• …
• …..
SUMMARY – STAFF UNDERSTANDING AND VIEWS ON CER (1/2)
Source: Staff Survey
Communicat-ionsCommunicat-ions
• …
Views on progressViews on progress
• ….
SUMMARY – STAFF UNDERSTANDING AND VIEWS ON CER (2/2)
Source: Staff Survey
Views on obstaclesViews on obstacles
• …
14
•Introduction – Survey purpose and response rates
•Results 1 – Staff understanding of and views on the CER Initiative
•Results 2 – Assessment of “building blocks for change”– Introduction to the “building blocks for change” framework– UNCT ratings of importance of building blocks for CER– Extent to which building blocks are in place today– Most important issues from individual questions
•Discussion – Review of key findings and identification of actions to take
•Appendix
PRESENTATION OUTLINE
NOTE:Yellow boxes will mark interesting findings, not necessarily requiring
action
NOTE:Red boxes will mark important
findings, that may indicate required action
15
“BUILDING BLOCKS FOR CHANGE” FRAMEWORK
Source: Staff Survey
OrganisationCulture &
Values
Manageability of Workload
Capacities & Skills
Motivation & Incentives
Account-ability
Clear Direction Leadership
Support from Government
Support from Donors
Support from Agency HQs
Need to know where we are
going …
Need to have the ability and
reasons to change …
Need to see others want the change …
16
17
UNCT RATING OF IMPORTANCE OF “BUILDING BLOCKS” Average score
*HoA version only, N=ZSource: Staff Survey
50%
50%
50%
50%
50%
50%
50%
50%
50%
50%
10%
10%
10%
10%
10%
10%
10%
10%
10%
10%
20%
1=Not at all important
2=Minor factor
3=Significant factor
4=Very important
5=Essential
Leadership
10%10%20%Capabilities and Skills
10%10%20%
Support from Headquarters
10%10%20%Support from Donors
10%10%
10%10%20%Clear Direction
Motivation and Incentives
10%10%20%Accountability
10%10%20%
10%10%20%
Organizational Culture and Values
10%20% 10%Manageability of CER Workload
10%20% 10%Support from the Government
a
b
c
d
e
f
g
h
i
j
All factors considered very
important – headed by Support
from Gov’t, Direction, and
Leadership.
18
EXTENT TO WHICH “BUILDING BLOCKS” ARE IN PLACE TODAY:*
Source: Staff Survey April 2008
4.00
3.00
4.00
3.00
3.00
4.50
2.00
4.00
3.00
3.00
1 2 3 4 5
Clear Direction
Leadership
Capabilities and Skills
Motivation & Incentives
Accountability
Organizational Culture and Values
Manageability of CER Workload
Support from Government
Support from Donors
Support from Headquarters
* Note: This shows the overall computed average per building block for the relevant questions from all version of the survey by adding up the sum of responses and dividing by the number of responses by building block. N differs by building block due to the drop out rate in the survey and ranges from AAA to BBB (CCC to DDD for questions only asked in the long survey). Source: Staff Survey
Fully in placeNot at all in place
(Almost) fully in place (Score > 3.66)
Halfway in place (Score >2.33 and <3.66)
2.33 3.66
Most of the “building blocks” seem to be fairly well in place ...
Not in place (Score <2.33)
19
“BUILDING BLOCKS” TODAY: full, short and HoA version
4.00
3.00
4.00
2.80
3.00
4.50
2.00
3.80
3.00
3.00
3.50
3.00
2.00
4.50
3.20
3.20
4.00
3.00
4.00
3.00
3.00
4.80
2.00
4.00
2.60
2.60
1 2 3 4 5
Clear Direction
Leadership
Capabilities and Skills
Motivation & Incentives
4.40Accountability
Organizational Culture and Values
Manageability of CER Workload
Support from Government
Support from Donors
Support from Headquarters
Long Survey – Min N = 118*
Short Survey – Min N =176*
HoA Survey – N=13
Note: For the Short version and the HoA version, the questions that form a building block are a subset of those questions that form the building block in the Full version* N differs by question and building block due to the drop out rate in the survey (max would be N=X for the Full version and N=Y for the Short version)Source: Staff Survey
Fully in placeNot in place at all
Respondents have similar views on the
“building blocks” – those heavily involved
in CER, those not much
involved to date and HoAs.
Overall average
3
3
4
2
4.5
3
3
4
3
4
19
20
“BUILDING BLOCKS” TODAY: range of average scores across agencies. Range between UN organizations/units
Minimum
1 = Not in place at all
1
3
5
2,50
Motivation & Incentives
4,50
Account-ability
3,50
Organizational Culture
and Values
3,50
Manage-ability of CER
Workload
4,50
Support from Government
3,50
Support from Donors
4,50
Support from HQ
Overall Average
3,50
Clear Direction
3,50
Leadership
4,50
Capabilities and Skills
Note: N for overall average = XXX, Building block ranges were computed by looking at the minimum and the maximum per building block among each of the UN Organizations. In some cases, the minimum or maximum may correspond to a UN organization for which individual results will not be shown due to insufficient number of responsesSource: Staff Survey
Fully in place
21
BUILDING BLOCKS – LIST OF 10 HIGHEST RATED QUESTIONS
* Not asked in short version** Not asked in short version and HoA versionSource: Staff Survey
• ….
22
BUILDING BLOCKS – LIST OF 10 LOWEST RATED QUESTIONS
^ Note : For the purpose of presentation, the original survey question has been negated and responses have been converted accordingly – i.e. “strongly agree” becoming “strongly disagree” etc. For example, “ I do not believe that the CER Initiative could lead to the removal of my post” was originally phrased as “I believe that the CER Initiative could lead to the removal of my post”. By reversing the statement, results become comparable on the 1 to 5 scale and can be included to compute the Building Block average.* Not asked in short version, ** Not asked in HoA versionSource: Staff Survey
• ….
23
CLEAR DIRECTION1 2 3 4 5
4,00*I know what are the objectives of the CER Initiative (n=334)
4,00*I understand why the UN system is pursuing the CER Initiative (n=330)
3,50I am receiving the information I need regarding the current status and the next steps being taken on the CER Initiative in country (n=330)
2,00**The UNCT (i.e. Resident Coordinator and Heads of Agencies) all have the same vision for the CER Initiative (n=137, Don't know/NA=16)
3,00*The CER Initiative agenda provides clear directionfor most of the UN’s activities in country (n=153)
3,00**I understand what ‘CER Initiative’ is going to mean for me and how it is going to impact my job (n=330)
3,00**I see the UN speaking with One Voice externally in country through coordinated communications and advocacy efforts (n=145)
Ø 3
* Not asked in HoA version** Not asked in Short versionSource: Staff Survey
Survey questions
Strongly disagree
Strongly agree
….
OverallOverall
• …
SUMMARY – ASSESSMENT OF “BUILDING BLOCKS FOR CHANGE”
Source: Staff Survey
Key issues to addressKey issues to address
• …
24
•Introduction – Survey purpose and response rates
•Results 1 – Staff understanding of and views on the CER Initiative
•Results 2 – Assessment of “building blocks for change”
•Discussion – Review of key findings and identification of actions to take
•Appendix
PRESENTATION OUTLINE
25
KEY FINDINGS THAT COULD MERIT ACTION
Source: Staff Survey
Key finding Evidence from staff survey
… • …
26
FORMAT FOR ACTION PLAN
Source: Staff Survey, TBD
Issue to address Actions to take Responsibility Timing
… • • •
… • • •
… • • •
… • • •
… • • •
… • • •
… • • •
… • • •
27
•Introduction – Survey purpose and response rates
•Results 1 – Staff understanding of and views on the CER Initiative
•Results 2 – Assessment of “building blocks for change”
•Results 3 – Staff well-being and fair treatment
•Discussion – Review of key findings and identification of actions to take
•Appendix
PRESENTATION OUTLINE
28
29
APPENDIX
“Building block” and well-being & fair treatment average scores by UN organisation/unit
Data tables by demographic breakdowns
Standard deviations for survey questions on each of the “building blocks”
30
BUILDING BLOCK – CLEAR DIRECTION1 2 3 4 5
Agency 4
2,00Agency 5
3,00Agency 6
3,50Agency 7
4,00Agency 8
4,00Agency 9
2,00Agency 10
Agency 11
3,00Agency 12
3,00
Agency 13
2,00Agency 17
3,00Agency 16
3,50Agency 15
4,00Agency 14
2,50
3,00Agency 1
4,00Agency 2
4,00Agency 3
3,50
Source: Staff Survey
Strongly disagree Strongly agree
Note: Where number of responses<5, responses
are not shown
31
APPENDIX“Building block” and well-being & fair treatment average scores by UN organisation/unit
Data tables by demographic breakdowns- Responses to questions on most important reasons for CER, most important objectives of CER and agency/UN identification by UN organisation, contract type, gender, etc.
- Responses to other questions by UN organisation/unit- Reponses to other questions by type of survey, programmes vs. operations, gender
- Responses to other questions by contract, involvement with CER, location and tenure
Standard deviations for survey questions on each of the “building blocks”
32
REASON FOR CER (1/2): What in your view is the most important reason why the CER Initiative is being pursued?
Source: Staff Survey
Demographics
A desire by the Country Team to improve the UN’s performance
Pressure from staffResponding to government demands
Responding to Donors
Responding to pressure from HQ Other
Aggregate Average A% B% C% D% E% F%
Survey version
Short surveyLong surveyHoA survey
UN organisation/unit
ABICDEFGHIJKLM
Programmes/ OpsProgrammesOprations
Type of Contract
Internationally recruited (including JPO/APO)
National Officer (NOA, NOB, NOC, NOD)G4-G7G1-G3
UN Volunteer (International and National)Consultant (Special Service Agreement, Service Contract, etc)Intern (including UNV intern)
Insert data in tables
33
APPENDIX“Building block” and well-being & fair treatment average scores by UN organisation/unit
Data tables by demographic breakdowns- Responses to questions on most important reasons for CER, most important objectives of CER and agency/UN identification by UN organisation, contract type, gender, etc.
- Responses to other questions by UN organisation/unit- Reponses to other questions by type of survey, programmes vs. operations, gender
- Responses to other questions by contract, involvement with CER, location and tenure
Standard deviations for survey questions on each of the “building blocks”
34
CLEAR DIRECTION – AVERAGE RESPONSE BY UN ORGANIZATION WHERE NO OF RESPONSES >4 (5= Strongly agree, 1= Strongly disagree)
QuestionAggregat
e average
Agency A
Agency B
Agency C
Agency D
Agency E
Agency F
Agency G
Agency H
Agency I
Agency J
Agency K
Agency L
Agency M
I know what are the objectives of the CER Initiative
I understand why the UN system is pursuing the CER Initiative
The CER Initiative agenda provides clear direction for most of the UN’s activities in country
I am receiving the information I need regarding the current status and the next steps being taken on the CER Initiative in country
The UNCT (i.e. Resident Coordinator and Heads of Agencies) all have the same vision for the CER Initiative
I understand what ‘CER Initiative’ is going to mean for me and how it is going to impact my job
I see the UN speaking with One Voice externally in country through coordinated communications and advocacy efforts
CLEAR DIRECTION - BUILDING BLOCK AVERAGE
Note: Where number of respondents <5, fields are marked as X – however, the hidden responses are still used to compute the building block averageSource: Staff Survey
Insert data in tables
35
APPENDIX“Building block” and well-being & fair treatment average scores by UN organisation/unit
Data tables by demographic breakdowns- Responses to questions on most important reasons for CER, most important objectives of CER and agency/UN identification by UN organisation, contract type, gender, etc.
- Responses to other questions by UN organisation/unit- Reponses to other questions by type of survey, programmes vs. operations, gender
- Responses to other questions by contract, involvement with CER, location and tenure
Standard deviations for survey questions on each of the “building blocks”
36
COMMUNICATION– AVERAGE RESPONSE WHERE NUMBER OF RESPONSES >4 (5= Strongly agree, 1= Strongly disagree)
Note: Where number of respondents <5, fields are marked as X, however, the hidden responses are still used to compute the building block averageSource: Staff Survey
1. Survey type 2. Programmes/Operations 3. Gender
Question Aggregate average Full
versionShort
versionHoA
version Pro-grammes Operations Female Male
I am receiving the information I need regarding the current status and the next steps being taken on the CER Initiative in country
I feel there is sufficient level of communication about the CER Initiative to outside stakeholders
I see the UN speaking with One Voice externally in country through coordinated communications and advocacy efforts
Did you attend the first Town Hall Meeting on xxx at xxx? (yes=4, no=2)
Did you attend the second Town Hall Meeting on xxx at xxx? (yes=4, no=2)
I find Town Hall Meetings an effective communication channel for learning about the CER Initiative (yes=4, no=2)
I find the One to Know Newsletter an effective communication channel for learning about the CER Initiative (yes=4, no=2)
I find the UN country website an effective communication channel for learning about the CER Initiative (yes =4, no=2)
Insert data in tables
37
APPENDIX“Building block” and well-being & fair treatment average scores by UN organisation/unit
Data tables by demographic breakdowns- Responses to questions on most important reasons for CER, most important objectives of CER and agency/UN identification by UN organisation, contract type, gender, etc.
- Responses to other questions by UN organisation/unit- Reponses to other questions by type of survey, programmes vs. operations, gender
- Responses to other questions by contract, involvement with CER, location and tenure
Standard deviations for survey questions on each of the “building blocks”
38
BELIEF AND SUPPORT (1/2)–AVERAGE RESPONSE WHERE NUMBER OF RESPONSES >4 (5= Strongly agree, 1= Strongly disagree)
Note: Where number of respondents <5, fields are marked as X, however, the hidden responses are still used to compute the building block averageSource: Staff Survey
Type of Contract Amount of time spent on CER Location Tenure within UN system Tenure with the UN in
country
Question Agg. Avg.,
Internatio
ns
NOA-
NOD
G4-G7
G1-G3 UNV
Consultan
t
Intern 0 0-
10%10%-25%
50%-75%
75%-100%
abc def ghi <1 year
1-2 year
s
> 2 and <5
years
> 5 and <10 year
s
> 10 year
s < 1
year
> 1 and < 2
years
>2 and <5
years
>5 and <10 year
s
>10 year
s
I like the idea of the CER Initiative
I believe that the CER Initiative is the right way to increase the impact of the UN system in countryI believe that the CER Initiative will increase the impact of my agency’s work in countryI believe the CER Initiative will significantly reduce inter-agency conflict within the UN system in countryI think it is a good idea for the UN to speak with One Voice in country, i.e. coordinating communications and advocacy effortsI am confident that the CER Initiative will be a success in countryI am confident that I can help to achieve the CER Initiative in country
Insert data in tables
39
APPENDIX
“Building block” and well-being & fair treatment average scores by UN organisation/unit
Data tables by demographic breakdowns
Standard deviations for survey questions on each of the “building blocks”
40
CLEAR DIRECTION1 2 3 4 5
4,00*I know what are the objectives of the CER Initiative (n=334)
4,00*I understand why the UN system is pursuing the CER Initiative (n=330)
3,50I am receiving the information I need regarding the current status and the next steps being taken on the CER Initiative in country (n=330)
2,00**The UNCT (i.e. Resident Coordinator and Heads of Agencies) all have the same vision for the CER Initiative (n=137, Don't know/NA=16)
3,00*The CER Initiative agenda provides clear directionfor most of the UN’s activities in country (n=153)
3,00**I understand what ‘CER Initiative’ is going to mean for me and how it is going to impact my job (n=330)
3,00**I see the UN speaking with One Voice externally in country through coordinated communications and advocacy efforts (n=145)
* Not asked in HoA version** Not asked in Short versionSource: Staff Survey
Survey questions
Strongly disagree Strongly agree Std.
Dev.
0,5
1,00
1,00
1,50
0,50
0,90
0,80