Embed Size (px)
Citation preview
www.destatis.de
ESSnet BigData 2018-2020
WPB Online Job Vacancies meeting
12 June 2019, Thessaloniki
www.destatis.de
Overview of ESSnet 2018-2020 WPB ”Online Job Vacancies”
www.destatis.de ESSnet 2018-2020 – Online Job Vacancies
» The aim: Implementing different big data sources according to online job vacancies OJV
» job portals,
» job adverts on enterprise websites
» OJV data from third party sources like CEDEFOP
» Using knowlegde gained from previous ESSnet 2016-2018
» Final goal: publication of indicators on OJV Keyword: experimental data
© Federal Statistical Office of Germany (Destatis) | Labour Market | Dr. Martina Rengers
www.destatis.de ESSnet 2018-2020 – Online Job Vacancies
» necessary conditions
» data sources and data access have to be sustainable / permanent
» for Germany data from (at the moment without a guarantee of sustainability)
o CEDEFOP
o FEA Federal Employment Agency
» main activities /tasks
» ensure a high data quality
» develop meaningful indicators regarding the statistical theme of online jobvacancies
© Federal Statistical Office of Germany (Destatis) | Labour Market | Dr. Martina Rengers
www.destatis.de
Using knowledge from ESSnet 2016-2018 WP1 ”Web scraping job vacancies”
www.destatis.de ESSnet 2016-2018 – publications July 2016 November 2016 July 2017 May 2018
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/images/4/49/Deliverable_1_1_final.docx 32 pages without annex Annex: 29 pages
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/images/6/64/WP1_Deliverable_1_2_final.pdf 27 pages without annex Annex: 8 pages
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/index.php/File:Deliverable_1_1_final.docx 19 pages without annex Annex: 65 pages
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/images/5/5e/SGA2_WP1_Deliverable_2_2_main_report_with_annexes_final.pdf 36 pages without annex Annex: 124 pages © Federal Statistical Office of Germany (Destatis) | Labour Market | Dr. Martina Rengers
www.destatis.de
July
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/images/4/49/Deliverable_1_1_final.docx
Deliverable 1.1 Inventory and qualitative assessment of job portals
ESSnet 2016-2018 – past publications (1)
32 pages without annex Annex: 29 pages
www.destatis.de
November 2016 Deliverable 1.2 Interim Technical Report (SGA-1)
1 Introduction 2 Job vacancy statistics within the ESS 3 Job Portals versus Enterprise websites 4 Job Vacancies versus Job Advertisements 5 Conceptual Model of Online Job Vacancy Coverage 6 WP1 Progress Reports by Country (February 2016 to October 2016) 6.1 Germany 6.2 Greece 6.3 Slovenia 6.4 Sweden 6.5 United Kingdom Annex: Description of Current Job Vacancy Survey/Statistics 1. Germany 2. Greece 3. Slovenia 4. Sweden 5. United Kingdom References
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/images/6/64/WP1_Deliverable_1_2_final.pdf
27 pages without annex Annes: 8 pages
ESSnet 2016-2018 – past publications (2)
www.destatis.de
July 2017 Deliverable 1.3 Final Technical Report (SGA-1)
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/index.php/File:Deliverable_1_1_final.docx
19 pages without annex Annex: 65 pages
ESSnet 2016-2018 – past publications (3)
www.destatis.de
May 2018 Deliverable 1.2 Final Technical Report (SGA-2)
Executive Summary 1. Introduction 1.1 Participation 1.2 Format of the report 1.3 Facts about OJV data 2. OJV Data Use Cases 2.1 Improving current job vacancy statistics 2.2 Classifying data from text descriptions 2.3. Measuring OJV coverage 2.4 Time series analysis 2.6 Data driven analysis 2.5. Other potential use case 3. Data Access 3.1 Introduction 3.2 Direct web scraping 3.3 Arranged access 3.3 Summary 4. Data Handling and IT 4.1 Data storage and data handling software 4.2 Data cleaning and de-duplication 4.3 Text Analysis and Classification 4.4 Flow to Stock transformation 4.5 Conclusion
5. Methodology 5.1 Definitions 5.2 Quality Assessment Frameworks 5.3 Measuring Coverage 5.4 Matching and linking 5.5 Time series analysis 6. Statistical Outputs 6.1 Estimates of on-line job vacancies 6.2 Indicators or nowcasts of labour
market activity based on OJV data 6.3 Geographic indicators 6.4 Concluding Remarks 7. Future Perspectives References Annex A: Belgium Annex B: France Annex C: Germany Annex D: Greece Annex E: Portugal Annex F: Slovenia Annex G: Sweden Annex H: United Kingdom
https://webgate.ec.europa.eu/fpfis/mwikis/essnetbigdata/images/5/5e/SGA2_WP1_Deliverable_2_2_main_report_with_annexes_final.pdf
36 pages without annex Annes: 124 pages
ESSnet 2016-2018 – past publications (4)
www.destatis.de
most important characteristics of the German circumstances in the context of OJVs:
» Extremely high number of job portals
» more than 1,600 job portals in Germany
» Frequently changes in the market
» changing business models
» frequently change in the ranking of job portals
» Restrictions regarding available information
» restricted hit lists (e.g. no more than 1000 ads displayed)
» little structured information available
» Great importance of Federal Employment Agency
» FEA is responsible for the job vacancy survey
» FEA is the biggest job portal owner in Germany
ESSnet 2016-2018 – main results (1)
© Federal Statistical Office of Germany (Destatis) | Labour Market | Dr. Martina Rengers
www.destatis.de
» problem of data quality of OJV data
» studies with data on the recruiting channels used by enterprises in Germany showed a quote for using online job portals between 41 and 70% => first coverage problem: online job vacancies do not represent all current vacancies
» lack of representativity of online job vacancies due to selection of job portals => second coverage problem
» problem of duplicates
» very low amount of structured information in OJV data
» answers to the following questions are necessary WHAT? – WHEN? – WHERE? – WHO?
» additionally: HOW MANY? In the past, OJV data from Federal Employment Agency showed that there are 1.6 job vacancies per ad on an average.
ESSnet 2016-2018 – main results (2)
© Federal Statistical Office of Germany (Destatis) | Labour Market | Dr. Martina Rengers
www.destatis.de
Next steps main activities
www.destatis.de
» using results from ESSnet 2016-2018
» Update assessment job portals
» What about Google for Jobs ??? » studying metadata of the OJV data from CEDEFOP » Germany: continued cooperation with Federal Employment Agency
» data access: investigating the readiness of portal owners to provide their data for statistical purposes
» data quality: investigating the possibilities of matching job portal data with the business register (to increase the data quality)
» developing meaningful indicators
ESSnet 2018-2020 – next steps (1)
www.destatis.de
» studying metadata of the OJV data from CEDEFOP » http://www.cedefop.europa.eu/en/events-and-projects/projects/skills-online-job-vacancies
» https://skillspanorama.cedefop.europa.eu/en
ESSnet 2018-2020 – next steps (2)
http://www.cedefop.europa.eu/en/publications-and-resources/publications/4172
http://www.cedefop.europa.eu/en/publications-and-resources/country-reports
Main Topics 1. Introduction 2. Online job vacancies and portals
in the EU 3. How to collect online job
vacancies 4. What information and for whom 5. Way forward Abbreviations and acronyms References
Country-specific reports
www.destatis.de
developing meaningful indicators – OJVs used in labour market reporting by public-law institutions (selection)
ESSnet 2018-2020 – next steps (3)
Country Institution Indicators Data basis Australia Australian government
http://www.ga.gov.au/ Internet Vacancy Index (IVI) https://data.gov.au/dataset/internet-vacancy-index
3 biggest job portals (SEEK, CareerOne and Australian JobSearch); Data provision by Department of Jobs and Small Business https://www.jobs.gov.au/
Astria Austrian Public Employment Service (AMS) , a public service provider http://www.ams.at/
Only available in German language
Qualifikationsbarometer http://bis.ams.or.at/qualibarometer/
Until reporting year 2015 job ads from print media – no ads from online job portals; From reporting year 2016 onwards job ads from online job portals; automated data collection and data processing by using the big data platform Jobfeed powered by the company Textkernel https://www.jobfeed.com/at/home.php See also: https://www.textkernel.com/hr-software/jobfeed/
Switzer-land
Swiss Job Market Monitor University of Zurich https://www.stellenmarkt monitor.uzh.ch/en.html
combined print-online index https://www.stellenmarktmonitor.uzh.ch/en/indices/combined.html
Weg scraping of 12 job portals and 1,350 enterprise websites
USA member-driven think tank The Conference Board https://www.conference-board.org/
The Conference Board Help Wanted OnLine (HWOL) https://www.conference-board.org/data/helpwantedonline.cfm
Help Wanted Advertising Index (HWI) of print ads was published for over 55 years and discontinued in 2008; since 2005 indexmeasures changes over time in advertised online job vacancies Help Wanted OnLine (HWOL); Situation in August 2018: More than 16,000 online sources; Since December 2018: revised HWOL index based on 28,000 different online job boards including traditional job boards, corporate boards, social media sites, and smaller job sites that serve niche markets and smaller geographic areas AND since December 2018 release of experimental HWOL Index Data delivery from the company Haver Analytics http://www.haver.com; cooperation with Wanted Analytics www.wantedanalytics.com which belongs to the American Company CEB www.cebglobal.com since November 2015; CEB itself was taken over by Gartner, Inc. www.gartner.com in April 2017.
US State California: EDD Employment Development Department https://edd.ca.gov
HWOL statistics http://www.labormarketinfo.edd.ca.gov/data/help-wanted-online%28hwol%29/ online-job-ads-data.html
See descriptions in the row above regarding the conference board.
www.destatis.de
developing meaningful indicators – OJVs (commercially) collected and analysed by private companies (selection)
ESSnet 2018-2020 – next steps (4)
Company URL/ registered office Observed country Product names Burning Glass https://www.burning-glass.com/
Boston, USA https://www.burning-glass.com/uk/ Edinburgh, United Kingdom https://www.burning-glass.com/au Christchurch, New Zealand
In principle, this analysis tool can be used for any country. For the time being, the following case studies are available: • Australia and Asia • USA: Missouri Economic Research Information Center • USA: Northeastern University • USA: University of Maryland, Baltimore County • United Kingdom: Company Active Informatics as official sales partner of Burning Glass
• Labour Insight TM
Haver Analytics http://www.haver.com New York, USA
• Australia • Canada • China • Europe
• Japan • New Zealand • United Kingdom • USA
Gartner, Inc. www.gartner.com Headquarter in Stamford (Connecticut), USA German locations in Munich, Düsseldorf and Frankfurt am Main
• worldwide active • Gartner TalentNeuron TM (previous: Wanted Analytics)
Indeed hiring lab https://www.hiringlab.org/ Indeed, Inc. Austin, USA
• Australia • Canada • France
• Germany • United Kingdom • USA
• analyses based on indeed’s own job portal
Textkernel
https://www.textkernel.com Amsterdam, Netherlands
Data for Europe und North America: • Austria • Belgium • Canada • France • Germany
• Italy • Netherlands • Spain • United Kingdom • USA
• Jobfeed
www.destatis.de
18
www.destatis.de
Thank you.
© Federal Statistical Office of Germany (Destatis) | Labour Market | Dr. Martina Rengers
