Steeple workshop - MediaMosa - Oxford, july 2011

MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work

Frans WardSenior Technical Product ManagerSURFnet Advanced Services

MediaMosa: Open Source Media ManagementSoftware to Build an Open Video Platform

“Open Video in Education”

Saturday, July 2, 2011

OVERVIEW

• About SURFnetAnd our services. Briefly...

• MediaMosa IntroductionWhat is it?

• MediaMosa FeaturesWhat can it do for you?

• MediaMosa ArchitectureHow is it build?

• Technology Scouting ProjectsHow can MediaMosa be of use here?

About SURFnet

• The SURFnet network is the national computer network for higher education and research in the Netherlands (NREN)

• SURFnet is a subsidiary of the SURF organization

• Not for profit, 80 employees

• 180 connected institutions, serving 1 million users

NREN, National Research and Education Network

The SURF organization

Policymaking

Task Organizations

Institutions

Customer Relation

Strategic Direction

SURFfoundation

SURFnet

SURFdiensten

SURFnet ServicesSURFnet provides advanced services to the

Dutch research and education community

High performance networking. SURFnet plays a leading role in the development of national, European and world-wide networking.

Authentication and authorization services to provide secure access to the network and other resources.

Advanced multimedia collaboration tools, including high quality audio/video streaming and communication.

NREN, National Research and Education Network

VP-CorePowered by

SURFmediaSURFnet’s online mediaportalhttp://www.surfmedia.nl/

✓ Video On Demand (VOD)✓ Live Streaming

Front-endsBack-ends

Facts and Figures (June 2011)

• 97.610 assets

• 15 TB data

• 47.979 accounts

• 11.450 logins per month

• 43 institutions using federative logins

• 4 content suppliers

• 248.049 views per month

SURFnet Video Services

SURFnet. We make innovation work1

VP-Core• Shared platform SURFnet and Kennisnet• Application, streaming-, transcoding servers + storage• Powered by MediaMosa

DEMO SURFMEDIA

http://ww.surfmedia.nl/

MediaMosa Open Source

Software to build a Media Management andDistribution Platform

Main Entry: 1me·dia-mo-saPronunciation: \ˈmē-dē-ə-mō-ˈzā\Function: open source software to build a media management and distribution platformRelease Date: 8 april 2009

In use by SURFnet and Kennisnet on their

VP-Core platform since July 2008

‣ Separation of front-end and back-end functionality

‣ Open source and open source components !

‣ Based on a Service Oriented Architecture

‣ Multiple end-user applications on a centralized video backend infrastructure

‣ Performance and High availability

‣ Scalable for future expansions

‣ Flexibility: combining components

MediaMosa Architecture Blueprint

➡ Common base for MediaMosa is Drupal 7

RESTRepresentational State Transfer

• All interactions (messages) with the MediaMosa platform are done with REST-calls.

• REST strictly refers to a collection of network architecture principles which outline how resources are defined and addressed.

• REST is a Client-server, Stateless, Cacheable and Layered protocol.

✓ This reduces the complexity ✓ improves the effectiveness of

performance tuning✓ increases the scalability of pure

server components

[GET] .../asset?limit=10<?xml version="1.0"?> <response> <header> <item_count>8</item_count> <item_count_total>8</item_count_total> <item_offset>0</item_offset> <request_process_time>0.0728</request_process_time> <request_query_count>55</request_query_count> <request_result>success</request_result> <request_result_description></request_result_description> <request_result_id>601</request_result_id> <request_uri>[GET] asset?limit=10&user_id=admin&is_app_admin=TRUE</request_uri> <vpx_version>2.3.11</vpx_version> </header> <items> <item id="1"> <asset_id>ZG3SmyybQ61abezpbVHrJkFF</asset_id>..... etc

WebservicesOver 185, divided in services for....

• Play Video (PlayProxy HTML wrapper)• Authentication (DBUS for EUA)• Authorization

(Domain, REALM, Group or mixed)• Upload (PUT, POST, FTP)• Transcoding• Media Management: media files, assets

and collections• Search: Contextual Query Language • Jobs• Metadata and OAI/PMH• Notification• Logging and Statistics

http://mediamosa.org/api

Flexible Metadata Element Sets

CRUD REST-calls on all objects possible. i.e.:• POST /asset/create?user=John• GET /asset/$asset_id • POST /mediafile/$mediafile?filename=NewName• POST /collection/$coll_id/delete?user=John

Metadata Element Sets Provided:• Standard Dublin Core (DC)• Qualified Dublin Core (QDC)• Learning Object Metadata (IEEE LOM) • ‘Content Zoek Profiel’ (CZP / NL LOM)

Objects are organized in assets, media files and collections

Transcoding Services

Based on FFMPEG a complete, cross-platform solution to record, convert and stream audio and video. It includes libavcodec - the leading audio/video codec library.

Access ManagementScreening

Default: Media is accessible for everyone. Option to set access restrictions for playing media on the following properties:

• Domain, or group of domains: i.e only accessible from .surfnet.nl

• Realm, or group of realms:i.e. using SURFfederation authentication infrastructure

• User, or group of users: only give rights to user=john or group "class-24"

Search Services

Simple Search: • GET /asset?owner=John• GET /asset?collection=7

Advanced Search using CQL level 2 :• “(dc.title = foo OR qdc.title_alternative = bar)” • “NOT (dc.title = foo AND dc.title = bar)” • “^cat ^dog tree^”

http://www.loc.gov/standards/sru/specs/cql.html

Support for Apache SOLR as alternative search engine!

Upload Services• POST upload using End User Application

(limited to 2 GB) • POST upload directly to MediaMosa Platform

using ticket system (limited to 2 GB)

• HTTP PUT upload using End User Application (i.e. Java Upload Applet)

• FTP batch upload (“no” limits) including

metadata in XML file • Quota per End User Application

• Support for Master / Slave content sharing(Provider Application / CLA)

MediaMosa

Metadata Harvesting using OAI-PMH

• is a low-barrier mechanism for repository interoperability. • Data Providers are repositories that expose structured metadata via

OAI-PMH. • Service Providers then make OAI-PMH service requests to harvest

that metadata. • OAI-PMH is a set of six verbs or services that are invoked within

http://oai.surfmedia.nl/request?verb=Identifyhttp://oai.surfmedia.nl/request?verb=ListSetshttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdchttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_dchttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_lomhttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=czphttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc&set=coll_id:794

MediaMosa Community Website & Online DEMO environment

http://mediamosa.org

http://demo.mediamosa.org

• Rich Media Systems Compared

• MediaMosa Building Block for Blackboard

• MediaMosa and support for other content

• Full text search engines

• Content in the Cloud

• MediaMosa and Open API

• Transcripting Technology

• Open Live Streaming

• MediaMosa RichMedia Application

• Content Supplier Application

• MediaMosa and Opencast Matterhorn

• HTML5 Video

TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT

MediaMosa Technology Scouts

MEDIAMOSA AND OPEN WEBSERVICES

Goal: 1) to provide an open interface for sharing data stored in a MediaMosa environment

2) to consume data from other open platforms and to integrate this in MediaMosa

MEDIAMOSA AND OPEN WEBSERVICESPROOF OF CONCEPTS

http://api.mediamosa.surfnet.nl/

MEDIAMOSA RICH MEDIA END USER APPLICATION

Goal: to provide a rich media presentation application using MediaMosa for presenting weblecture recordings

• Rich Media = Weblecture Recording

• 2 playback modes: Video - Video or Video - Slides

• Using export of a MediaSite recording

• Automatically producing slides from video

• Demo available on MediaMosa demo-site: http://demo.mediamosa.org/richmedia

MEDIAMOSA RICH MEDIA END USER APPLICATION

MEDIAMOSA TRANSCRIPTING TECHNOLOGY

Disclosure of audiovisual archives

UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/

• The number of AV-archives on the Internet increases rapidly

• Archiving is not enough: disclosure and reusing is required!

• The use of speech technology is needed (Reduce human effort).

• The number of AV-archives on the Internet increases rapidly.

• Adding Metadata is the key component here.

• The use of speech technology is needed (Reduce human effort).

Huge amount of workand no time-coded relations with video

Adding metadata, the traditional approach:Manual annotation

Adding metadata, the new approach:Exploiting Speech technology for metadata generation

Speech Recognition(Speech-to-Text)Time-coded Transcript

Indexing and Search:Search on fragment level

Audio Extraction

• Transcripting: conversion of speech into a written or electronic text document.

• Automatic Speech Recognition (ASR) seems to be the ideal technology for this.

• In combination with Optical Character Recognition (OCR) of slides.

• Goal: to provide additional metadata for searching in video / lecture recordings.

DEMO’s SPEECH RECOGNITION

http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demohttp://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo

MEDIAMOSA TRANSCRIPTING TECHNOLOGYThe Technology Scout Project. The process is complex...

MEDIAMOSA TRANSCRIPTING TECHNOLOGY SCOUTING PROJECT

MediaMosaTranscription by Spraak

Multi-SourcePlayer

Partners:

• Enhanced Search• Optional Subtitles• Mashup info

Lecture Recording

End User Application

• Recognize the Speech• Produce time-coded

Transcript

• Recording of Teacher• Recording of Slides• Reference material

• Transcode into audio• Store all into an asset

MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work

OPEN SOURCE MULTI-SOURCE HTML5 PLAYER

RECORDING BOX LECTURE RECORDINGCommunity Development Projects

Picture in Picture, Chapter marking, Text Recognition, Recording Player for Flash and iPad

• Automatic publishing• Create and use metadata• Rich Media content• All metadata searchable

MEDIAMOSA INNOVATION PROJECTS IN 2011Weblecturing pilot with the University of Groningen (RUG)

Community Development ProjectsMEDIAMOSA DRUPAL MODULES

Drupal 6

Drupal 7

MediaMosa Status & Roadmap

Continued Development: 2011: Two major releases based on new Drupal 7 framework.MediaMosa 3.0: focusses on Open InterfacesMediaMosa 3.5: focusses on Transcripting Technology (speech-2-text)

Other MediaMosa Projects 2011:• Weblecture Pilot MediaMosa - Matterhorn• Proof of Concepts Transcripting Technology• Proof of Concepts flexible workflows

(Enhanced support for other content than audio/video)

Available on mediamosa.org

Release 2.3.11

MediaMosa 3.0Focus on open interfaces, open standards and OpenSocial

MediaMosa OpenAPI interface:Own interface in MediaMosa for support for open REST calls and other related functions:• Search• oAuth• oEmbed• open upload

Open standards: • JSON, ATOM feed

OpenSocial: • a common API for social applications across multiple websites

SURFnet. We make innovation work1 MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work

1.  SURFfederatie SAML

2.  SURFteams (grouper)

3.  OpenSocial

4.  Collaboration tools

External Services

Campus Services

Supporting Services •  SURFfederatie •  SURFteams •  OpenSocial

Functional Components

OpenSource: www.OpenConext.org

Sourcecode: Apache License, v2.0

Content: CC “Attr. 3.0 Unported”

Portal

Engine Block

OpenSocial Container

Platform Management interface

MediaMosa Directions

MediaMosa

Thanks

for yo

attenti

WWWhttp://mediamosa.org

Online Demohttp://demo.mediamosa.org

Forumhttp://mediamosa.org/forum

Issue Trackerhttp://mediamosa.org/trac

Source Codehttps://github.com/mediamosa

Slidesharehttp://www.slideshare.net/MediaMosa

Twitterhttp://twitter.com/mediamosa

Steeple workshop - MediaMosa - Oxford, july 2011

Technology

STEEPLE RUN VIEWS · STEEPLE RUN VIEWS Official Publication of the Steeple Run Neighborhood . Steeple Run Community Council . . Michael Klecka - President Tom Zakosek – VP

Expertiseseminar MediaMosa 10-juni, SURFnet

The Wicked Steeple

MediaMosa Foundation - Webstroom 15 april 2013

MediaMosa and Open Webservices - SURFnet Relatiedagen 2010

Madcap mediamosa still_generation

MediaMosa: plannen & activiteiten in 2010

MediaMosa Future - Community day 8 december 2011

Norwegian studietur MediaMosa 22 november 2011

SURFmedia & MediaMosa

MediaMosa Player - Open source HTML5 weblectures player

Drupalcafe meets MediaMosa - 17 october 2013, Utrecht

Opencast and Steeple

MediaMosa version 3.0

Steeple September 2014

STEEPLE analysis Singapore

MediaMosa en EDIT: Online Onderwijs Makkelijk Gemaakt

Technology Scan MediaMosa – Matterhorn Connecting Matterhorn and MediaMosa

SURFnet video dienstverlening: SURFmedia, MediaMosa, Cinegrid

MediaMosa and webservices