Digital Archive. Bojan Kosi, Mediateka

Preview:

Citation preview

Mediateka

Digital archive

Bojan Kosi

01. 05. 2023 Mediateka RTV Slovenija

RTV Slovenia

2

• three national radio channels

• three national TV channels

• radio and TV channels for the Italian and Hungarian minorities

• radio and TV channels for Slovenian minorities in Italy and Hungary

• radio an TV programmes for Romany community

• radio channel for foreign audience

• teletext, internet and mobile

• symphony orchestra, big band, choirs

• label company

01. 05. 2023 Mediateka RTV Slovenija

Archive in 2012

3

carriers/meters hours % hours1 2 3 4=(2*3)

Audio tape Rtv Slo 200.000 150.000 100 % 150.000 CD & CDR Rtv Slo + others 70.000 55.000 60 % 33.000 DAT Rtv Slo 10.000 15.000 100 % 15.000 files Rtv Slo 80.000 50.000 100 % 50.000

Total 360.000 270.000 248.000

Videotape Betacam (+SP) Rtv Slo + others 59.800 75.800 75 % 56.850 Videotape Digital Betacam Rtv Slo 620 720 100 % 720 Videotape MPEG IMX Rtv Slo 14.200 20.800 100 % 20.800 DVC Pro Rtv Slo 2.380 4.500 100 % 4.500 Videotape MGS 1" Rtv Slo 11.000 19.300 100 % 19.300

Total 88.000 121.120 102.170

Film - B&W Rtv Slo 12.820.000 18.700 100 % 18.700 Film - Color Rtv Slo 7.210.000 10.500 100 % 10.500 Perforated magnetic tape Rtv Slo 6.800.000 9.900 100 % 9.900

Total 26.830.000 39.100 39.100

for digitization

Video

Audio

Media type Carrier type ProductionArchive content

Film

01. 05. 2023

Mediateka - Digital archive

4Mediateka RTV Slovenija

Management and development:- workflow management and system development

Ingest:- digitizing, ingesting and archiving

Catalogue:- virtual segmentation and metadata annotating

Restoration:- physical carrier restoration

01. 05. 2023

MediatekaDigital archive

Physical archives

Production systems

New relations

5Mediateka RTV Slovenija

Archive system(Ingest & MAM & storage)

Ljubljana

Koper Ljubljana Maribor Lendavaolddatabase

Koper

migration ingest ingestingestingest

exchange

Lendava

exchangeexchange

Maribor

01. 05. 2023 Mediateka RTV Slovenija 6

Archive MAMdiffers from

production MAM.

01. 05. 2023 Mediateka RTV Slovenija

… and workflows are the key solution…

7

01. 05. 2023 Mediateka RTV Slovenija

Workflows are the key solution…

8

Usually over 3.000 flows are managed simultaneously from Archive MAM:

• digitizing / ingesting contents from physical carriers

• daily created digital content ingesting,

• cataloguing

• ordering and distribution

• meta data extraction

• informing the users

01. 05. 2023 Mediateka RTV Slovenija 9

Audio

01. 05. 2023 Mediateka RTV Slovenija

Audio digitization project… DONE!

10

• 2002-2004 Searching the solution, preparing the project

• 2005 Ingest system tender

• 2006 Archive MAM system tender

• 2007 Configuring and testing the system and workflows

• 2008-2014 Massive digitization phase

carriers hours % hours1 2 3 4=(2*3)

Audio tape Rtv Slo 200.000 150.000 100 % 150.000 CD & CDR Rtv Slo + others 70.000 55.000 60 % 33.000 DAT Rtv Slo 10.000 15.000 100 % 15.000 files Rtv Slo 80.000 50.000 100 % 50.000

Total 360.000 270.000 248.000

for digitization

Audio

Media type Carrier type ProductionArchive content

01. 05. 2023 Mediateka RTV Slovenija 11

Videotape

01. 05. 2023 Mediateka RTV Slovenija

Videotape digitization project

12

• 2013 Searching the solution, preparing the project

• 2014 Ingest & MAM system upgrade

• 2015 Configuring and testing the workflows

• 2015-2021 Massive digitization phase

carriers hours % hours1 2 3 4=(2*3)

Videotape Betacam (+SP) Rtv Slo + others 59.800 75.800 75 % 56.850 Videotape Digital Betacam Rtv Slo 620 720 100 % 720 Videotape MPEG IMX Rtv Slo 14.200 20.800 100 % 20.800 DVC Pro Rtv Slo 2.380 4.500 100 % 4.500 Videotape MGS 1" Rtv Slo 11.000 19.300 100 % 19.300

Total 88.000 121.120 102.170

for digitization

Video

Media type Carrier type ProductionArchive content

Videotape – general flow

01. 05. 2023 13Mediateka RTV Slovenija

Mediateka – Digital archiveTV archive

Cleaning &

checking

Selecting &

preparing tapes

QC

Virtual segmentation

& Cataloguing

Digitizing &

Ingesting

01. 05. 2023 Mediateka RTV Slovenija

Videotape – Ingest

14

01. 05. 2023 Mediateka RTV Slovenija

Videotape – Ingest flow

15

01. 05. 2023 Mediateka RTV Slovenija

Videotape – Long term archive format… FFV1

16

• open source and available under GNU LGPL,

• hardware independent,

• able to support the 4:3, 16:9 and other picture format,

• able to support SD, HD, 2K and other resolutions,

• able to map all current colorspaces, including subsampling options,

• mathematically lossless (when encoding),

• playable with standard player, without extra payable decoders

• …

01. 05. 2023 Mediateka RTV Slovenija

Ingest & MAM & storage

17

01. 05. 2023 Mediateka RTV Slovenija 18

Film

01. 05. 2023 Mediateka RTV Slovenija

Film restoration & digitization project

19

• 2013 Searching the solution, preparing the project

• 2014 Film scanner tender, Ingest & MAM system

upgrade

• 2015 Configuring and testing the workflows

• 2015-2040 Restoration & digitization phase (25 years)

Estimated labour cost: 7.000.000 EUR (~180 EUR per hour)

meters hours % hours1 2 3 4=(2*3)

Film - B&W Rtv Slo 12.820.000 18.700 100 % 18.700 Film - Color Rtv Slo 7.210.000 10.500 100 % 10.500 Perforated magnetic tape Rtv Slo 6.800.000 9.900 100 % 9.900

Total 26.830.000 39.100 39.100

for digitization

Film

Media type Carrier type ProductionArchive content

01. 05. 2023 Mediateka RTV Slovenija

Film

20

01. 05. 2023 Mediateka RTV Slovenija

Film – Vinegar syndrom

21

Film – general flow

01. 05. 2023 22Mediateka RTV Slovenija

MediatekaTV Arhiv

Restoration & cleaning

(film)

Restoration(perfo)

Selecting &

preparing the

material

Digitization (film)

Cataloguing

Picture QC

Digitization(perfo)

Audio QC

01. 05. 2023 Mediateka RTV Slovenija

Film – restoration

23

01. 05. 2023 Mediateka RTV Slovenija

Film – restoration & jumbo role

24

01. 05. 2023 Mediateka RTV Slovenija

Film – jumbo role

25

01. 05. 2023 Mediateka RTV Slovenija

Film –jumbo role

26

01. 05. 2023 Mediateka RTV Slovenija

Film – jumbo role types

27

01. 05. 2023 Mediateka RTV Slovenija

Film – jumbo role types

28

B&W films

ORIGINALS1 REVERSAL - MUTE2 REVERSAL - SEPMAG3 REVERSAL - COMMAG rare4 NEGATIVE - MUTE5 NEGATIVE - SEPMAG rare

PRINTS6 PRINTS - MUTE7 PRINTS - COMOPT8 PRINTS - SEPMAG9 PRINTS - COMMAG rare

PERFORATED MAGNETIC TAPES

COLOR films

ORIGINALS1 REVERSAL - MUTE2 REVERSAL - SEPMAG3 REVERSAL - COMMAG rare4 NEGATIVE - MUTE5 NEGATIVE - SEPMAG rare

PRINTS6 PRINTS - MUTE7 PRINTS - COMOPT8 PRINTS - SEPMAG9 PRINTS - COMMAG rare

PRINTS (ORANGE MASK)10 PRINTS - MUTE12 PRINTS - SEPMAG

01. 05. 2023 Mediateka RTV Slovenija

Film – scanning

29

• DPX

• 2K

• 10bit log

• QC

• segmentation (EDL)

• making TAR packages (automated)

• no digital restoration

• no color correction (no grading)

01. 05. 2023 Mediateka RTV Slovenija

Film – file ingest flow (MAM)

30

• extracting DPX from TAR package

• checking timecode and frame number

• encoding mezzanine video & merging audio

• analysing & keyframes

• Human QC

• Encoding FFV1 & proxy

• Sending to the storage (DPX & FFV1 & proxy)

01. 05. 2023 Mediateka RTV Slovenija

Film – MediaFormats example

31

01. 05. 2023 Mediateka RTV Slovenija

Storage (audio & video & film)

32

• HSM (online – nearline – offline)

• LTO6, up to 30 PB in 25 years

01. 05. 2023 Mediateka RTV Slovenija

Access

33

Metadata objects

Serie

Programme

01. 05. 2023 34Mediateka RTV Slovenija

Project

Playout slot

Schedule

Carrier

Playout slot

Spored

Entity

Entity

Avtor

Izvajalec

Contract

Recommended