"the suitcase" project cloud qtr meeting presentation @ disney/abc

THE SUITCASEA USC SHORT FILM

BY ABI DAMARIS CORBIN

Next Generation Cloud Based WorkflowIngest, Transcode, Store, Orchestrate

c4 FrameworkIntegrate, Efficacy

MetadataCollect, Manage, Interoperability, New Ontologies

The Suitcase

Core GOALS

High Dynamic RangeAdoption, ACES

360 Camera Capture Narrative Experience, Live Stream

The Suitcase

Extended GOALS

Ingest Directly into the Cloud (Edge Landing Pad) Using a secure high-speed connection, ingest camera RAW files directly onto cloud storage.

Transcode Utilizing Cloud Computing Using a private cloud store as the hub, transcode camera RAW files using either Amazon Elastic Compute Cloud (EC2) or Google Compute. Take advantage of scalability and parallel processing to run all transcodes simultaneously.

Utilize Private Cloud Storage as Centralized Data Store Using a private cloud store as a work in process store for applications such as Avid, Nuke, Maya, and After Effects.

Next Generation Cloud BasedWorkflowTest Cases

Utilize Orchestration Software to Integrate with Different Services Analyze and utilize Agnostic Orchestration Software to automate functions concerning movement and creation of digital media assets within the cloud pipeline.

Production Workflow

5

C4 ID management and integration Report on the qualitative value and ease of incorporating the C4 ID system for tracking digital assets across vendors and tools.

JSON RESTful API deployment Integrate C4 compatible API’s with select production software applications and services to communicate within the C4 framework.

Data authority and synchronization Evaluate the framework’s ability to resolve authoritative data sources, and the use of C4 IDs to authenticate data accuracy.

c4 FrameworkTest Cases

Automation Report on opportunities to improve production workflows using C4 enabled automation.

User Impact Determine the effects of C4 on the processes of domain experts in production. Evaluation includes human factors, opportunities to improve existing departmental workflows, interoperability, and integration with established filmmaking processes.

Software and Services Integration

Efficacy

Collection and management Evaluate the improvements to the workflow, capture, storage and accessibility of metadata.

Interoperability Evaluate methods for establishing reliable interoperability between data sources. Analyze practical considerations such as unified metadata storage vs data silo integration via framework.

Input / Output Identify metadata inputs and outputs for key production software and hardware.

MetadataTest Cases

Ontologies Report on metadata needs of existing Ontologies, and what schemas are commonly applied to production metadata gathered. Identify areas of potential application such as marketing and distribution. Map a single set of metadata for the Suitcase to a structured ontology.

TheSuitcase-MetadataTestCase

MetadataTestCaseRequirement:Extractasinglesetofdescrip3vemetadataforTheSuitcase,mappedtoastructuredontology.

TheTestCase

Defini5ons

Metadata(forourpurposes)=informa3onaboutthecontent(asopposedtoe.g.viewershipinforma3on)•Example:episode3tleNOTNielsenra3ng

Descrip5ve=informa3onaboutwhatisgoingononscreen(asopposedtotechnicaloropera3onalmetadata);includestemporalmetadata•Examples:characters,loca3ons,onscreenac3ons,scenebreaks

Ontology=datamodeldefiningtherela3onshipsbetweenaGributesofinterest•Example:Acharacterappearsinascene

Seman5cOntologies

Informa5onisrepresentedastriples:

Aflexible,dynamicwaytorepresentinforma3onthatfacilitatestheabilitytoruncomplexqueriesagainstthedatasetaswellasapplica3ondevelopment.

JoeFranekisPlayedByMojeanAria

Subject Predicate Object

Triplescanbelinkedtogether…

JoeFranek

MojeanAria

“I’mnottheexplosionkinda

guy” Scene7

playsCharacter

hasDial

ogue

occursIn…tohelpanswerques4onslike:whatisthesceneinwhichMojeanAria’scharactersays“I’mnottheexplosionkindaguy”?

MetadataApplica5ons:General

Search/Research:Searchongranularfacetsandmetadatafields

ProductDevelopment:Powernewproductsorfeatures(personaliza3on,t-commerce,etc.)

Analy5cs:SurfacepaGernsinourcontentthatarenotintui3ve.

MetadataApplica5ons:TheSuitcase

Efficientlysearchforandgenerateclipsbasedondescrip5vemetadata,whicharerequiredforvariouspurposes,including(1)marke5ngmaterials/promos;(2)actors(forreels).

Samplequeries:• “RetrieveaclipofthebombsceneforChris4an”• “Retrieve4mecodesrepresen4ngtheclimaxofthestory,tosendtotheshopcuKngthetrailer”

Generateasetofinforma5onthatisusefultodownstreamdistributorstohelpengineernewproductfeatures.Samplequeries:• “Provideinfoaboutthetalentonscreenatagiven4mecode,sothatdownstreamdistributorcansurfacebiographicalinforma4ononasidebar”

• “Provideinfoaboutapieceofluggageonscreenatapar4cular4mecode,sothatavendorcansurfacealinktopurchasetheobjectinques4on”

MetadataCategoriesofInterest

High Priority Lower Priority

Character (appearances) Props/Objects

Talent Wardrobe

Locations/Settings Music

Actions/Events (Car Crash, Explosion, Kiss, Argument)

Event Types (Climax, Turning Point, etc.)

Dialogue

Scene/Shot Breaks

StretchGoal:UpstreamMetadataExtrac5on

High Priority Lower Priority

Character (appearances) Props/Objects

Talent Wardrobe

Locations/Settings Music

Actions/Events (Car Crash, Explosion, Kiss, Argument)

Event Types (Climax, Turning Point, etc.)

Dialogue

Scene/Shot Breaks

Answertheques3on:Canweextractauthorita3ve,structuredmetadatafromtheproduc3onprocess,ratherthanrecrea3ngitdownstream?

Challenge:Richermetadatalivesupstream(pre-produc4on/produc4on)butissubjecttochange—par4cularlydifficultfortemporalmetadata.Dataextractedtowardstheendofthepost-produc4onworkflow(par4cularlytemporalinforma4on)ismoreauthorita4ve,butnotalwaysasrobust.

FinalDraY

MovieMagic

ScriptE

scenechronize

SyncOnSet

Avid

MetadataExtrac5onWorkflow

1.Ontologycrea5on CharTalentplaysCharacter

EventsKissingDrivingArguing

Snoopingetc.

CharactersJoe Franek

Kelly Sully Dropo

Donald Timiltyetc.

ControlledVocabulary: AuthorityList:

sceneswithDonaldTimilty6.Architectsearchportal/APIs/alterna5vesolu5onsforsurfacingdatatoendclients

2.Controlledvocabularydevelopment+authoritylists

3.Loadontologyintoseman5cdatabase

4.Createinstancedata(“tag”TheSuitcasefinalcut)

5.Constructqueriesfordataextrac5on

scenechronize

Camera

Audio

Movie Magic

Final Draft

AVIDEditiorial

PIX PIX Dallies DI/Matering

Software

Mark Logic

C4Framework

SyncOnSet

Grey Meta

ColorfrontTranskoder

Source MetadataC4 MetadataModified Metadata

KeyThe Suitcase - Metadata WorkflowVersion 0.4 / September 1, 2015

Shotgun VFXSoftware

VFX CreationSoftware

MetaData Workflow

16

Adoption Report on production considerations for filming with HDR including departmental training, workflow, color grading and mastering.

ACES Workflow Report on the application of an ACES HDR workflow to ensure consistent color management throughout.

High Dynamic RangeTest Cases

Camera

The Suitcase - ACES / HDR WorkflowVersion 0.2 / October 14, 2015

On-SetDIT Cart

Co-LoDAM Cart

OpenEXR16-bit

ACESREC2020 ODT

ColorfrontOSD

ACESMaster

ColorfrontOSD

On-SetMonitoring

HDRLUT

Capture Post Deliver

ColorfrontTranskoder

PrimaryColor Grade(Dual Grade)

Camera RAWACES EXRDelivery Grades

Key

P3 1000nit

GradedOpenEXR

REC709Master

P3Master

REC2020Master

ACESP3 ODT

ACESREC709 ODT

REC709

REC709Metadata

HDR Workflow

18

Interactive Linear 360 Narrative Design and shoot a narrative scene using a 360 camera.

Live On Set 360 Streaming Use a 360 camera on set to live stream the production as it happens.

360 Camera CaptureTest Cases

THE SUITCASEVIRTUAL REALITY

THE SUITCASEVIRTUAL REALITY

VR COMPLIMENTVR LIVE STREAMLive stream a day on the production set in 360 degrees to a Mobile phone

VR headset

An immersive Prequal from the perspective of the terrorist and the

suitcase

Live Stream in Virtual RealityVideostitch will live

stream the set in 360 degrees on November

17th or 18th. This will be Viewable on

the Wemersive app with a Samsung Gear

VR Headset

VR COMPLIMENT

w/Augmented Reality Projection Dome

360 Footage from VR

Compliment Projected onto

Geodesic Dome at Festivals.

Audiences mobile phone acts

as Augmented Reality

X-Ray machine to see inside

The Suitcase

Funding Partners

Infrastructure / Hardware Partners

Software Partners

Cloud Service Provider Partners

Studio Partners