Implementing a media archive - lessons learned

  • View
    27

  • Download
    0

Embed Size (px)

Text of Implementing a media archive - lessons learned

1. FOUNDED 21 Dec. 12 2. Not (only) a Broadcast Archive 3. CULTURAL HERITAGE We dont own collections We provide services towards 50+ orgs BROADCAST CITY ARCHIVES SERVICE PROVIDER 4. STRONGER TOGETHER Collectie Huis Van Alijn | Huis Van Alijn 5. DIGITISATION ARCHIVING DISSEMINATION 6. DIGITISATION 7. HERITAGE + MEDIA HERITAGE MEDIA Type materiaal/ formaat # DRAGERS TOTAAL UREN TOTAAL # dragers aandeel % # dragers aandeel % Film 74.173 26.709 11% 89% Video analog 150.389 228.773 26% 74% Video digital 225.578 156.189 5% 95% Audio analogue 165.883 78.370 36% 64% Audio digital 34.870 18.112 54% 46% TOTAL 650.893 508.153 21% 79% INVENTORY ANALOGUE CARRIERS 8. FIRST DIGITIZATION WAVE 9. ALL DIGITIZATION WAVES UPTO450TB/MONTH 10. ALL DIGITIZATION WAVES UPTO450TB/MONTH 11. WOI Evergem's Yzerblad: komt uit de loopgrachten als t past (S.l. 1917 1918) Collectie Erfgoed- bibliotheek Hendrik Conscience | Vlaamse Erfgoedbibliotheek Foto: Stefan Tavernier WW I Newspaper project 12. ARCHIVING 13. Slide 14 Scalable, redundant preservation system 14. Slide 15 MAM system 15. DISSEMINATION 16. QUID PRO QUO 17. CPs Education Libraries Research TARGET AUDIENCE 18. EDUCATION 19. Slide 20 FROM ARCHIVE TO CLASSROOM 20. ARCHIVE SYSTEM PROCUREMENT / INSTALLATION 21. BUDGET 2013-2014 11.8 mio EURO TIME CONSTRAINT 22. TIME CONSTRAINT Evaluation after 18 months START JAN 1, 2013 (staff: 1) Get and keep all customers on board Start all services within 1 year 23. VIAA NOW TEAM ARCHIVE 4 people 14 FTE 24. March 2013 - Greenfield! 25. lessons learned 26. May 2013 - Greenfield! 27. Public Procurement 28. surveys towards users UX Designed according to their needs Creates buy-in! requirements gathering workhops involving users Users co-wrote our RFP 29. PRIOR NOTICE Transparent Procurement Proces DETAILED ALLOTMENT REPORT (debrief) 30. EVALUATION JURY 31. Working with a jury Jury consisted of Stakeholders (future users) International experts VIAA staff Why? A balanced answer / evaluation Jury members add weight & credibility Again: user buy-in! 32. 3 EU tenders - Timeline of procurement June 2013 : prior notice August 2 : Candidates invited September 12 : Candidates selected September 13 : RFP published October 17 : Quotes received November, 6 : Allotment November 25 : Final allotment April 2014 : MAM in production 33. Slide 34 Three copies (2 MAMs) 34. Archive system 35. Slide 36 Zeticon MediaHaven 36. Main MAM services mul@-tenant MAMSYSTEM 1.IMPORTWORKFLOWS& INGESTREPORTING 3.EXPORT WORKFLOW(OAI- PMH),EXITPATH 2.MANAGEMENT -Transcoding(mpeg) -Par@alre@eve -Metadata -Time-basedAnnota@on -Search(~SOLR) -ManualQC -StorageManagement 37. Slide 38 Processing capacity & ramp-up Processing capacity: => up until 13 TB / day (and still scaling) 38. WORKFLOWS 39. Practical MAM use We work along the lines of OAIS for dening Ingest process (SIP denition) Long term preservation (AIP) Dissemination (DIP) Denition in a service agreement Practical agreement between VIAA and CP Usually for one collection (e.g. audio digitization) 40. Ingest workow from digitisation We use PREMIS for provenance Every step in the process is recorded digitization rm, CP, VIAA, registration, carrier inspection, digitisation, encoding, Each having a time and outcome + notes Analogue carrier or digital equivalent 41. Complete ow => more than 1 MAM 42. 1. Registration of the carrier / AMS AMSfunc@ons: Analoguecarrier registra@on PIDcrea@on Supportthe logis@csprocess Technical characteris@cs Metadatafrom digi@za@on 43. Persistent identier creation 44. Persistent identier creation 1Analoguecarrier= 1IntellectualEn@ty= 1PID 45. Persistent identier ThePIDisthekeyforkeeping trackofalleventsthathave animpactonthedigital object. Wemonitorthecomplete lifecycleofthedigitalobject, fromregistra7onto dissemina7on 46. 2. Ingest validation SIPcontains Essence(MXF) Metadata(XML) QCReport(XML) 47. 2a. Transfer validation 48. 2b. SIP validation 49. 2c. Storage 50. Allmetadatageneratedduringtheingestprocessis storedasPREMIS. 51. MAM workow - Ingest monitoring using PREMIS 52. Ingest monitoring using PREMIS 53. Error handling 54. Error handling (Tableau report) 55. Step 3: Archived 56. HowbigistheVIAAarchive? Whichmimetypesdowehaveinthearchive? Howmanyitemsdowearchive/CP? 57. grappigefotovanVIAAteamendashboard? 58. Items Archived 59. 539,6TB 47.273items Size of the VIAA archive 539TB 50.000items 60. TB archived per CP 61. Step 4: Reuse / interaction 62. Collectie Huis Van Alijn Huis Van Alijn 63. Road Ahead Collectie Huis Van Alijn Huis Van Alijn 64. Road ahead Ingest of born digital material Complex and many (50+) data sources Need for a SIP creator Realisation through integration with an enterprise service bus Should we be a TDR? Builing along the lines, looking into certication 65. CONCLUSIONS Collectie Huis Van Alijn Huis Van Alijn 66. CONCLUSION MAM system Took a while to understand business needs Found a very exible partner in Zeticon Perfect MAM system? Flexibility through well documented APIs Pluggable! Interface: Usability HTML5 Standards: support for and keep up with PREMIS, RDF, DC:TERMS, OAI-PMH, 67. THANKS! Collectie Huis Van Alijn Huis Van Alijn