21
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands. Centre of Competence in digitisation Clemens Neudecker, National Library of the Netherlands IMPACT Demo Day, Biblioteca Nacional de España

Bne impact co_c

Embed Size (px)

DESCRIPTION

Presentation introducing IMPACT Center of Competence presented by Clemens Neudecker during demo session held at the BNE 5th of October 2011.

Citation preview

Page 1: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Centre of Competence in digitisation

Clemens Neudecker, National Library of the NetherlandsIMPACT Demo Day, Biblioteca Nacional de España

Page 2: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Overview of this presentation Challenges to be adressed

The IMPACT Project and its achievements

The IMPACT Centre of Competence

Get involved now!

Twitter: @impactocr, #impactproject

Page 3: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

KB Digital Library Programme Goal: Offer everyone access to everything published in and about

the Netherlands through the internet

2013: 10% of the publications published in and about the Netherlands available in digital form

Example projects:Historical Newspapers – http://kranten.kb.nl Dutch Parliamentary Papers – http://www.statengeneraaldigitaal.nl/ Dutch Print Online – http://www.dutchprintonline.nl/

Timeframe covered: 1618 - 1995

Page 4: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Historical text: typical OCR results

VVt Venetien den 1.Junij, Anno 1618.DJgn i f paffato te S' aö'Jifeert mo?üen/ba

.)etgi'uotbciraetail)i.r/JtmelchontDecht te /sbnbe bele btr felbrr geiufttceert baer bnber eeniglje jprant o^fen/bie

ftcb .metbeSpaenfcbeu enbeeemgljen bifet Cbeiiupcen berbonbru befe

Page 5: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

OCR Challenges: damaged pages, difficult layout, historic fonts … and many more

Page 6: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Language Challenges: Spelling & orthographical variants, inflected forms…and more

Historical variants of the Dutch word ‘wereld’ (world):werelt weerelt wereld weerelds wereldt werelden weereld werrelts waerelds weerlyt wereldts vveerelts waereld weerelden waerelden weerlt werlt werelds sweerels zwerlys swarels swerelts werelts swerrels weirelts tsweerelds werret vverelt werlts werrelt worreld werlden wareld weirelt weireld waerelt werreld werld vvereld weerelts werlde tswerels werreldts weereldt wereldje waereldje weurlt wald weëled

Page 7: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Institutional Challenge: lack of knowledge and expertise inefficiency

Page 8: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Adressing these challenges: The IMPACT project Consortium of 26 partners

Good mix of public and private partners Users, researchers and industry work together to find solutions Each established in a large international network

Coordinated by the National Library of the Netherlands (KB)

Large-scale Integrating Project EU funding: € 12 100 000 (FP7 ICT Work Programme) Start date: 1 January 2008 (extended feb-april 2010) Duration: 4 years From 2012: sustainable Centre of Competence Currently, over 125 people across Europe, Israel and Russia

involved in the project

Page 9: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Page 10: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

IMPACT Main Achievements at this point Improved commercial OCR (ABBYY ‘IMPACT’ FRE 10 on market) Effective tool for OCR correction with volunteer involvement (CONCERT)

ready for implementation Novel Approaches to preprocessing, OCR and post correction available Computer lexica for nine languages close to delivery Digitisation Framework with evaluation tools available Facility to plug in other tools (Your tools!) Large Dataset with sophisticated Ground Truth close to final delivery Knowledge bank with guidelines and learning resources A unique network bringing together experts from different communities New website under construction: digitisation.eu Centre of Competence to be launched at final conference 24 and 25

october 2011

Page 11: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

A Centre of Competence in digitisation: Why? Challenges in digitisation of historic material still there No lack of novel approaches to improve access:

IMPACT and many others Challenge: implementation in real life Challenge: direction of research Need for real life datasets with Ground Truth Need for real life testing and evaluation Need for support in implementing the solutions

Page 12: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Centre of Competence: What**pending approval of IMPACT consortium

Not for profit organisation Mission: to support the process of making Europe’s heritage

accessible in digital form Web based international community with small core facility for

support Curates IMPACT achievements and provides tools, services and

facilities for further advancement of the State of the Art in this field Focuses on practical solutions Distributed effort by IMPACT partners spreads risk and ensures

continuing engagement Income generation by offering number of resources and services

at a fee (mix of subscription and pay as you go)

Page 13: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Page 14: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Centre of Competence: Who? Digitisation practitioners in content holding institutions Researchers in the field of historical document processing and

language technology Service providers End users (Researchers in the humanities who need access to the

content)

IMPACT Centre of Competence offers distinct value to each of these target groups

Page 15: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Centre of Competence*: benefits for content holders** Exchange of best practice in community of content holders with digitisation programmes Knowledge Bank with comprehensive and up to date information and technology watch reports Training on demand and on line tutorials Online support through a Helpdesk Support in the implementation of IMPACT solutions for improving access to text Access to the IMPACT Dataset with Ground Truth and tools for evaluation Open Source Digitisation Framework: workflows for digitisation and beyond Language Resources: a set of historical lexica that can be utilised in OCR Conferences/workshops with focus on demonstration and implementation Working together on future practical solutions with scientific communities in the area of

pattern recognition, language technology, image processing

*pending approval of IMPACT consortium **access depends on membership level

Page 16: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Centre of Competence*: Benefits for researchers**

New community: Bridging the gap between specialist research and real life needs

Brings together scientific communities in the area of pattern recognition, language technology, image processing with a focus on large scale digitisation

Access to content holding community Access to large real life datasets and ground truth Working on implementation of research prototypes/products into digitisation

environment Facilities for testing and evaluating new tools and IMPACT tools Working groups and comittees Access to new projects and funding opportunities Conferences/workshops with focus on demonstration and implementation

*pending approval of IMPACT consortium **access depends on membership level

Page 17: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Centre of Competence*: Benefits for service providers**

Access to content holding community with large scale digitisation programmes Access to large real life datasets and ground truth Facilities for testing and evaluating new tools and IMPACT tools Attend conferences Working groups and comittees Make yourself known to your clients through yellow pages on website Sponsorsship and exhibition opportunities Working together with content holders and researchers on practical solutions

*pending approval of IMPACT consortium **access depends on membership level

Page 18: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

Join the Centre by becoming a member!Three levels of membership (pending final decision IMPACT consortium) :

Open (registration) access to forum, part of content Basic membership (fee): access to all facilities, reduced fee for conferences Premium membership (fee): member of the Board, privileges such as free

entry to conferences

Want to sign up?

Mail to [email protected] for information on membership join us now already on Linked In Follow us on twitter Access through www.impact-project.eu Come to our conference on 24 and 25 october

Page 19: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

LinkedIn group: IMPACT Improving Access to Text

Building an online community

Collecting feedback on IMPACT deliverables (to be incorporated in later versions)

Discussions on topics related to digitisation, OCR & language technology

Page 20: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

www.impact-project.eu

Twitter: @impactocr, #impactproject

Page 21: Bne impact co_c

IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.

IMPACT final conference: 24-25 October 2011

Digitisation & OCR: Better, faster, cheaper Solutions of the IMPACT Centre of Competence and future challenges

Presentation of final results of IMPACT & related research in the area of OCR, digitisation and language technology

Location: The British Library, London, UK Registration and more news available through the IMPACT website:

www.impact-project.eu