Professor Teresa Sordé, Member of the IMPACT-EV project research team and Professor at the Sociology Department in the Universitat Autònomade Barcelona

IMPACT-EV: Evaluating the impact and outcomes of EU

SSH research (FP7)Teresa Sordé

Autonomous University of Barcelona

Impact & the Humanities Queen’s University Belfast, 8th June 2015

1. Introduction

2. What do we mean by impact?

3. SIOR: the Social Impact Open Repository

1. Introduction



Social Sciences are questioned all around the world

SBE: Social, Behavioural and

Economic Sciences

Social Sciences are questioned all around the world

The Commission eliminated the SSH in

the draft of Horizon 2020

Máire GEOGHEGAN-QUINN EU Commissioner for Research, Innovation and Science

The Academies' voices and the Parliament restored SSH, but at tenure track

All European Academies

SSH in Horizon 2020

1. Health, demographic change and wellbeing

2. Food security, sustainable agriculture and forestry, marine, maritime and inland water research, and the bioeconomy

3. Secure, clean and efficient energy4. Smart, green and integrated transport5. Climate action, environment, resource

efficiency and raw materials6. Inclusive, innovative and reflective

societies7. Secure & innovative societies

Thanks to the campaign initiated by SSH researchers, the European Parliament decided there had to be a specific Challenge on SSH

Seven broad challenges

http://europa.eu/rapid/press-release_MEMO-13-1085_ca.htm

Improvement of citizens’

living conditions

SOCIALIMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication

Policy makers look for

science-based policies

Policy implementati

on POLICY IMPACT

SCIENTIFICIMPACT

Science-basedEC

communication

NO Connectio

n

Policy makersdo not take EU

scientific research & EC

communications into account

Noimprovement of citizens' living

conditions

SOCIALIMPACT

Policy implementatio

n POLICY IMPACT

SSH with Social Impact

Support for SSH

SSH without Social Impact

Questioning the SSH


conditions

SOCIALIMPACT

Federico Mayor Zaragoza (Director General UNESCO 1987-1999):I won’t go to another Conference where diagnoses on poverty are presented, because the best diagnosis is the autopsy but it comes too late. We need solutions based on evidences and we need them now.

Improvement of citizens’ living

conditions

SOCIALIMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication



Policy

implementation POLICY IMPACT

SCIENTIFICIMPACT

Science-basedEC

communication

NO Connection

Policy makersdo not take EU

scientific research & EC

communications into account


conditions

SOCIALIMPACT

Policy implementation

POLICY IMPACT

SSH with Social ImpactSupport for SSH

SSH without Social ImpactQuestioning the SSH


conditions

SOCIALIMPACT

IMPACT-EVEvaluating the impact and

outcomes of European SSH research (2014-2017)

Research Team

Director: Ramon Flecha (CREA – University of Barcelona, Spain)

Members:

MTAK KIK-TTO, Hungary (András Schubert, Editor of Scientometrics)

Trinity College Dublin, Ireland. (Paul Holm, the President of the European Consortium for Humanities Institutes and Centres (ECHIC)

DANS-KNAW, The Netherlands, Center for Organisational Research (CORe), Università della Svizzera Italiana, Switzerland, Institute for Economic Research on Firms and Growth (CERIS–CNR), Italy, Trinity Long Room Hub, Population and Social Policy Consultants (PSPC), Belgium, Health Economics Research Group (HERG), Brunel University, United Kingdom.

IMPACT-EV

The main objective of IMPACT-EV is to develop a permanent system of selection, monitoring and evaluation of the various

impacts of Social Sciences and the Humanities research. IMPACT-EV will not only develop indicators and standards for evaluating scientific impact of SSH research but especially, for evaluating their policy and

social impact.

Some of the research activities we are requested to conduct:

1.The criteria and quantification of the social impact (ex ante and ex-post) of projects from all scientific areas.

2.To explain the evaluators how to use these criteria

3.The ex-post evaluation of all SSH projects of the FP7 (2007-2013) and last call FP6 (2006).

4.The creation of an open repository on research social impact.

Evaluating the impact and outcomes of European SSH research

EC contribution: 2.271.709 €

Strategies for inclusion and social cohesion in Europe from Education

EC contribution: 3.361.503 €

The creation of new occupational patterns for cultural minorities

EC contribution: 650.128 €

Solidarity in European societies: Empowerment, social justice and

citizenship EC contribution: 2.495.608 €

1. Solar Energy

2. Coronary Heart disease

3. Planes

4. Alzheimer

5. Electric car6. Micro-chip

7. Alpha mannosidosis disease

8. Architecture

9. Clinical partnership

10. INCLUD-ED (SSH)

http://europa.eu/rapid/press-release_MEMO-11-520_es.htm?locale=fr

1. Introduction



a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT


SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

112 indexed articles

Authorships: 54 female researchers24 male researchers

Among them: 27 senior35 junior

16 PhD Students

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT


SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT


Transference

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

We have transference when policy makers, NGOs, schools or citizens use our research results to plan and carry out their interventions

28th of April, 2005 - Resolution of the situation of the Romani People in the European Union:

The Council, the Commission, the member states and the candidate countries are asked to:

Consider the recognition of the Romani People as a European minority (European Parliament, P6_TA-PROV(2005)0151)

9th of March, 2011- Resolution on the EU strategy on Roma inclusion (European Parliament, 2010/2276(INI))

Concepto de Actuaciones Educativas de Éxito

Successful Educational Actions

2009 and 2011: European Parliament, Brussels

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

Distinguish:a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact

Social Impact

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

Problem with transference: many policy makers and citizens say that when they use researchers evidence they get worse social results

We have social impact when transference achieves better social results

Social impact are the evidence based improvements experienced by individuals

and societies, according to societal objectives, resulting form the transference

of excellent research.

1MONTSERRAT SCHOOL (Terrassa- Spain)

•Area and families from de lowest SES percentile (mostly North African families from Morocco).

•High unemployment and poverty rates.

• Learning Community since 2001/2002.

Low achievers in Mathematics

Interactive Groups

- Diverse people (volunteers, family members,...) come into the classrooms.

- Pupils are organized in heterogeneous groups

- Each volunteer facilitates the interactions among the children in each group

- The teacher manages the classroom

3CEIP LA PAZ (Albacete- Spain)

Learning community since 2006-2007

• In 2006, it was the poorest and most excluded neighborhoods in Spain

• Teachers could not go into the school. The police tried to help them and could not go either

Teachers ask for protection to enter the school

La Milagrosa neighbourhood

“Las seiscientas”

The police did not dare to enter the barrio

Social Indicator (EU2020 targets)

Social Impact Indicator from research outcomes

70% of the population between 20-65, employed

Number of new jobs in areas with high rates of unemployment

Source: Cooperativa Miguel Fenollera. (2013). Resultados de 2012 para la esperanza, en tiempos de crisis. Available at: http://www.coopmfenollera.com/2013/02/08/resultados-de-2012-para-la-esperanza-en-tiempos-de-crisis/

- 13 new jobs (10 permanent and 3 temporary contracts) in the coop.- 317 new jobs in the field of agriculture- 6 contracts to manage the labor training of employers.- 4 contracts in the management of the cooperative.

Creation of “La Milagrosa cooperative” in a neighborhood in extreme poverty (Albacete, Spain. 2011)

1. Introduction



-non-profit

-Launched by the IMPACT-EV consortium (European Commission).http://www.ub.edu/sior/index.php

It is an open source repository to store evidence of social impact.

Any researcher or research group around the world can freely upload evidence of their research social impact.

Any institution or citizen can freely see the evidences of the studies, researchers and research groups with social impact

factor through accessing to SIOR website.

SOCIAL IMPACT OPEN REPOSITORYhttp://www.ub.edu/sior/sior.php [email protected]

In order to create a account, researchers and research institutions have to register with their ORCID ID or with their email address

Description of Research ProjectPrincipal Investigator &Research TeamSocial TargetsSocial Impact of the Project

SOCIAL IMPACT CRITERIA

1) Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

2) Percentage of improvement achieved in relation to the starting situation.

3) Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

4) Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies, and

5) Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time

SIOR takes those targets already defined by citizens through their democratically

elected representatives as a reference to define what is considered social impact.

Font: http://ec.europa.eu/archives/commission_2010-2014/president/news/documents/pdf/20100303_1_en.pdf

• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the departing situation.

Score Criteria

10 30% of improvement

9 20-29% of improvement

8 10-19% of improvement

7 Some improvement


• Connection to United Nations Millennium Goals, EU2020 target or other similar official targets

• Percentage of improvement achieved in relation to the starting situation.

• Transferability of the impact, the actions developed based on the project’s findings have been transferred to other contexts besides the original one

• Publication in scientific journals (with a recognized impact), governmental or non-governmental official bodies

• Sustainability, the impact achieved by the action developed based on the project’s findings has showed to be sustainable throughout time


• In this repository only the researchers and studies that have had social impact appear.

• Even if their value is 1 it means a good result, because many others do not even achieve enough social impact to be in this repository.


Before publishing the project, the SIOR team revises all the information uploaded (peer review), and if everything is correct, the project is published.

An example

Social impact from SSH research. One example:Archeological findings in Atapuerca:

Scientific Impact

Dissemination

Dissemination

Transference

Transference

• Creation of employment

Museum of Human Evolution (created in 2010): •500.000 visitors •More than 1130 new jobs•Economic impact: 53 million €

Atapuerca has contributed to improve the knowledge about our own history, by discovering an hominid (Homo Antecessor), which is possibly the first human being in the European continent. Contribution to understanding humanity.

To sum up…

• SIOR is an ongoing process directed by academics and counting with the support of the technical team.

• SIOR is already transforming the scientific community:– Researchers who do not know whether their work has

achieved social impact, start to consider it and seek for evidences (even in finished projects)

– Researchers whose work does not have achieved social impact, start to consider it.

Allow researchers and research institutions make clear contributions to science, to the societies and to their own work

Increase the visibility of this research worldwide Addressing the concern about social impact across the research

community

We cannot change the past, but we can change the present and the future, and SIOR, among many other initiatives, is

already contributing to do so.

Thank [email protected]

@SIORepository@impact-ev

Social Impact

Transference of Learning communities and SEAs to 8 Latin American countries

2013-2015

Learning Communities in Latin America

http://www.comunidadedeaprendizagem.com/

24 schools as LC

104 schools with SEAs

32 schools in training

Brazil

Source: Natura Institute

Mexico:6 schools as Learning Communities implementing SEAs3 schools participating in training on LC and implementing SEAs

Peru:7 schools as Learning Communities implementing SEAs9 schools participating in training on LC and implementing SEAs

Colombia:8 schools as Learning Communities implementing SEAs

Guatemala:3 schools participating in training on LC

Argentina:7 schools participating in training on LC in February 2015

Chile:2 school participating in training on LC in February-March 2015

• Located in Andarai (Rio de Janeiro)

• Part of the pilot of LC in Brazil

• Learning community since

2013

GEC EPITACIO PESSOA (Rio de Janeiro)

Level of satisfaction of school community

My big dream, which is the motto of Learning Communities, is to have the

community, parents, society within the school helping in the educational

process of these students.School principal, Rio de Janeiro

If I have doubts, I call the teacher, and so I am also learning, I'm remembering my school days… I learn as much they do.School employee and volunteer, Rio de Janeiro

Brazil

Learning Communities in PERU

Since 2013…

1,258 children and adolescents participating in LC

5 schools started family education activities.

10 rural schools implementing DLG.

800 teachers have known LC

65 teachers have received training on LC and SEAs

Over 150 parents and family members have participated as volunteers in the implementation of SEAs

63 family members of Piura have participated in DLG

94 Teachers have participated in Dialogic Pedagogic Gatherings

Before I didn’t have such confidence, but now I can tell my classmates what I feel, what I think, my view of the text, in

which it is helping me ... I perform better, I can participate in class, I

haven’t the fear that I had before. Student participating in DLG, Cusco

Like any parent, you want your child to succeed, to learn more, you try to teach that everything can be solved ... parents have to put their bit to make this better for them.Father, Volunteer, Lima

Peru

Mexico

It is an excellent program, I wish it will be implemented not only in this county, in this school, but nationally.Teacher, Nuevo Leon

It's very nice, children teach each other to share, to listen to different

opinions, to respect, one as a mother realizes that.

Mother, Nuevo Leon

Schools as Learning Communities in Brazil

Schools as Learning Communities in Peru

Schools as Learning Communities in Mexico

Schools as Learning Communities in Colombia

Training in Learning Communities in Argentina and Chile

February 2015

Origin of the Social Sciences

Origin and transformation of Humanities

Percentage of pupil enrolments that are regular absentees MORNING AFTERNOON Mean

Academic year 2011/2012

40% 53,45% 46,72%

Successful Educational Actions


10% 19,35% 14,67%


5,37% 6,79% 6,08%


1,26% 0,63% 0,94%

School Absenteeism and educational success

Academic year 2011-2012


21,05% 80%Transformation into a Learning Community

Outcomes in Pre-school (5 years old) (% achievement reading and writing)

MEDITERRANI SCHOOL (Tarragona- Spain)



30% 60%

Transformation into a Learning Community

MEDITERRANI SCHOOL (Tarragona- Spain)

Year 5: % Educational achievement

In 2012-2013 family and community participation increases- 22 family members engaged in 6 training activities held in the school

Social Impact

Transference of Learning communities and SEAs to 8 Latin American countries

2013-2015

Source: Cooperativa Miguel Fenollera. (2013). Resultados de 2012 para la esperanza, en tiempos de crisis. Available at: http://www.coopmfenollera.com/2013/02/08/resultados-de-2012-para-la-esperanza-en-tiempos-de-crisis/

- 13 new jobs (10 permanent and 3 temporary contracts) in the coop.- 317 new jobs in the field of agriculture- 6 contracts to manage the labor training of employers.- 4 contracts in the management of the cooperative.

Creation of “La Milagrosa cooperative” in a neighborhood in extreme poverty (Albacete, Spain. 2011)

Low achievers in Mathematics

103

Distinguish:a) Scientific Publicationsb) Disseminationc) Transferenced) Social Impact

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

Social Impact

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

SCIENTIFICIMPACT

ERA

Science-basedEC

communication

Science-basedEC

communication




conditions

SOCIALIMPACT


POLITICAL IMPACT

Problem with transference: many policy makers and citizens argue that sometimes when they use the evidences provided by researchers, they get worse social results.

We have social impact when transference serves to achieve better social results.

Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations.

Social impact are the evidence based improvements experienced by individuals and societies, according to societal objectives, resulting form the transference of excellent research.

Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organizations and nations