![Page 1: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/1.jpg)
1
A Media Mixer for online learning
Lyndon NixonMODUL University
Internet of Education 2013Ljubljana, Slovenia11-November-2013
Making learning materials more valuable for their ownerand more useful for their consumer
![Page 2: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/2.jpg)
14.02.13 Slide 2 of 30
Structure of the talk
• Trends in e-learning: more creation and consumption of video
• Required multimedia technology• Media fragment creation, description
and re-mixing in a case study: VideoLecturesMashup
• The MediaMixer offer for your content
2
![Page 3: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/3.jpg)
14.02.13 Slide 3 of 30
Trends in e-learning
3
![Page 4: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/4.jpg)
14.02.13 Slide 4 of 30
Online video is growing
4
• 78 hours of video is uploaded to YouTube per minute
• Online mobile video viewingVideo streaming accounts for 37% of all mobile traffic
Of all video streaming traffic, YouTube accounts for 45%
A Cisco study on mobile traffic growth expects• 66% of all traffic by 2014 will be video• having increased 66-fold from 2009 to 2014
![Page 5: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/5.jpg)
14.02.13 Slide 5 of 30
Online education is growing
5
• Learners & teachers are using the Internet both as a complement and a replacement to traditional learning– 60 million downloads of Open
University materials at iTunes U in 4 years– “classroom flipping”: watch the
lecture at home, spend time in class on the exercises
![Page 6: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/6.jpg)
14.02.13 Slide 6 of 30
Online video based learning
6
• Open content: Open CourseWare (20 000 courses)
• Massive lecture capture system: Opencast Matterhorn project (700 universities)
• Online portals specialised in video lectures:– Polimedia– VideoLectures.NET• 25 000 academic videos
![Page 7: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/7.jpg)
14.02.13 Slide 7 of 30
Requirements on video-based learning
7
– E-learners need to be able to search and retrieve the material they are looking for (based on its subject)
– Consumption trends towards mobile and on-the-go means interest focuses on the parts of the material of particular interest
![Page 8: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/8.jpg)
14.02.13 Slide 8 of 30
What about sharing & monetarizing content?
8
• Huge & growing amounts of valuable AV material but unable to effectively re-distribute or re-sell it.
• Media owners & platforms would like to continue to benefit from the (online) availability of (older, long tail) content – currently content to make a free distribution (cf. open video) or use ad-supported hosting (eg. YouTube)
![Page 9: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/9.jpg)
14.02.13 Slide 9 of 30
The rise of MOOCs
9
• MOOCs: Massive Open Online Courses– 3 million user accounts, over 400 000
students registered within 4 months at edX– A learning „offer“ may be a remix of
different content sources• Cost saving against recording new material• Tailored learning course for each learner•Multiple value from a single learning unit
![Page 10: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/10.jpg)
14.02.13 Slide 10 of 30
Needed media technology
![Page 11: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/11.jpg)
14.02.13 Slide 11 of 30
Media metadata
As video collections grow, how to find again a specific video part?
• Computers can only automatically extract low level media features while humans tend to query with high level “concepts” or “events”–Query by Example(QBE)– Content based Media Retrieval– Computer Vision“Semantic gap” an ongoing research
issue!
![Page 12: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/12.jpg)
14.02.13 Slide 12 of 30
Media metadata (2)
http://www.techspot.com/news/49172-google-creates-neural-network-teaches-itself-to-recognize-cats.html
![Page 13: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/13.jpg)
14.02.13 Slide 13 of 30
Media metadata (3)
• Textual metadata has long been a key factor in media collections –Dublin Core has summarized the
main fields for indexing and retrieval; different industries have developed richer metadata models –Manual entry by collection experts,
varying terminology and interpretation– Increasing automated production of
metadata from all available input sources (e.g. ASR, OCR, subtitling, transcripts, associated text...)
![Page 14: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/14.jpg)
14.02.13 Slide 14 of 30
Media metadata (4)
• Effective retrieval needs good query formulation– Controlled / known vocabularies– System learning, query suggestion or
drill-down search– Term normalisation / mapping
• „Named entity recognition“ (NER) extracts distinct entities out of natural language text–Disambiguation & classification– Trend towards global unique
identification
![Page 15: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/15.jpg)
14.02.13 Slide 15 of 30
Media metadata: trade-off
• More metadata – better retrieval / computer supported re-use–More manual curation – more cost–More automated creation – less
accuracy
Pre-annotate Using automatictechniques
Annotate Human oversight via intuitive tool
![Page 16: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/16.jpg)
14.02.13 Slide 16 of 30
Pre-annotation
• Determine the fragments of the video material and their topics– Segmentation based on 'natural
markers'– Concept detection in video– Topic identification from extracted
textPre-annotate Using automatictechniques
Annotate Human oversight via intuitive tool
![Page 17: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/17.jpg)
14.02.13 Slide 17 of 30
Annotation
• Model the video description in a structured and semantic way– Structured metadata format–Media fragment identification– Entities mapped into a knowledge
domainPre-annotate Using automatictechniques
Annotate Human oversight via intuitive tool
![Page 18: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/18.jpg)
14.02.13 Slide 18 of 30
Storage and retrieval
• Metadata store alongside the media repository– Query by topic on the metadata store• Topic expansion via the knowledge model
– Result set is a list of relevant video fragments
![Page 19: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/19.jpg)
14.02.13 Slide 19 of 30
The MediaMixer hub
19
• Video analysis tools• Video annotation tools• Video metadata creation and publication• Digital rights management• Media search and retrieval• Media negotiation, purchase and re-use
![Page 20: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/20.jpg)
14.02.13 Slide 20 of 30
VideoLecturesMashup
Use case and demonstrator developed in MediaMixer project
With Jozef Stefan Institut, Viidea and the VideoLectures.NET platform
Credits: Tanja Zdolsek and Ana Fabjan (JSI)
![Page 21: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/21.jpg)
14.02.13 Slide 21 of 30
MediaMixer use case: VideoLecturesMashup
Extend e-learning video platform VideoLectures to mash up video fragments for learners to quickly browse across distinct collections on the same topic.
![Page 22: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/22.jpg)
14.02.13 Slide 22 of 30
MediaMixer use case: Video fragment creation
Fragments were created based on the slide synchronisation timeline.
Transcripts (auto-generated by speech-to-text technology where necessary) were parsed and split across fragments.
… there are three Kingdoms of Life, Bacteria, Archaea and Eukaryota...
![Page 23: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/23.jpg)
14.02.13 Slide 23 of 30
MediaMixer use case: Video fragment annotation
Fragments were then annotated by extracting topics from their textual metadata (slide OCR or speaker transcription).
Topics are connected to a global knowledge model (DBPedia).
Video Fragment (4:41-5:12)
Archaea
![Page 24: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/24.jpg)
14.02.13 Slide 24 of 30
MediaMixer use case: Video fragment management
Annotations are managed in a separate metadata store.
The store provides a semantic query endpoint returning lists of video fragments matching a query topic (including semantically related topics)
Archaea
Acidiplasma
„type“ relation
Video Fragment (4:41-5:12)
![Page 25: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/25.jpg)
14.02.13 Slide 25 of 30
MediaMixer use case: Video fragment playback
The front end uses HTML5 or Flash. Both codebases are extended to support video fragment playout.
Individual playback can be modified to linear or non-linear channels (for e.g. a TV or mobile video experience)
![Page 26: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/26.jpg)
14.02.13 Slide 26 of 30
Demo @ mediamixer.videolectures.net
![Page 27: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/27.jpg)
14.02.13 Slide 27 of 30
The MediaMixer offer
![Page 28: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/28.jpg)
14.02.13 Slide 28 of 30
MediaMixer community portal
Free sign-up
Intro to all technology at community.mediamixer.eu/about
Updated with latest materials on all Media Mixer topics:
Technology use cases Demonstrators Tutorials, cf. Core Technology Set Presentations Software Specifications
http://community.mediamixer.eu
![Page 29: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/29.jpg)
14.02.13 Slide 29 of 30
MediaMixer Webinars
LIVE Webinars at http://mediamixer.eu/livecover all technology areas and use casesRECORDINGS on VideoLectures.NETNext live talk this Thursday 14.11. at 1100 CET
![Page 30: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/30.jpg)
14.02.13 Slide 30 of 30
MediaMixer Winter School
Learn about and get hands-on experience with the media technology.http://winterschool.mediamixer.eu
![Page 31: MediaMixing for e-learning - making learning materials more valuable for their owner and more useful for their consumer](https://reader036.vdocuments.mx/reader036/viewer/2022070312/55396f304a79594f6c8b4996/html5/thumbnails/31.jpg)
31
Thank you for your attention!
Contact us:
Membership - http://community.mediamixer.eu
Collaboration - email [email protected]
Say hello @project_mmixer