MP22 Standardisation RoadmapRob Koenen, TNO, [email protected]
Principal Consultant, TNOCo-chair MPEG-I activity
Co-chair, MPEG Roadmap activity
Third Mini-Workshop on Immersive Live Experience (ILE)Holiday Inn Macao Cotai Central, Macao,
24 October 2017, ITU-T SG16 meeting
For an explanation of the (many) acronyms in this presentation, see
https://mpeg.chiariglione.org/docs/mpeg-strategic-standardisation-roadmap
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
Why a Standardisation Roadmap?
• MPEG has created, and is still producing, media standards that enable huge markets to flourish
• MPEG works on requirements from industry• Many industries represented in MPEG, but not all of
MPEG’s customers can or need to participate in the process
• MPEG wants to inform its customers about its long-term plans (~ 5 years out)
• … and collect feedback and requirements from these customers
• … including in this session
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
What is in the Roadmap
• Our roadmap is a short document.
• It briefly outlines MPEG’s most important standards
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
1990 2000 20101995 2005 2015
MP3MPEG-2 Video & Systems AVC HEVC
MP4 FF MMTDASH
AAC
InternetAudio
Digital Television
Music Distribution
Media Storage and Streaming
UHD & ImmersiveServices
New Forms of Digital Television
Unified MediaStreaming
OFF
HD DistributionMobile Video
Custom Fonts on Web & DigiPub
MPEG-4 Video
MLAF
Second Screen
3D Audio
MPEG Standards
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE) ‹#›
What is in the Roadmap
• Our roadmap is a short document.
• It briefly outlines MPEG’s most important standards
• It then gives an overview of MPEG’s activities
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
MPEG-1,2,4,H,I
MPEG-7
MPEG-21
MPEG-A
MPEG-B,C,D, DASH
MPEG-E,M
MPEG-U,V
MPEG’s Areas of Activity
Compression of video, audioand 3DG
Description of video, audio and multimedia for content search
Technologies for content e-commerce
Multimedia Application Formats (combinationsof content formats)
Systems, video, audio and transport
Multimedia Platform
Technologies
Device and application interfaces
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
What is in the Roadmap
• Our roadmap is a short document.
• It briefly outlines MPEG’s most important standards
• … it then gives an overview of MPEG’s activities
• … and then an overview of all MPEG’s standards
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
1990 2000 20101995 2005 2015
Video
Video
AVC HEVCSPVideo ASP
SystemsPS/TS DASH
MMT
MP4 FF TT
Media-related
MPEG-V
CDVS
DID
CEL/MCOCENC
UD
MDS
AudioMP3 AAC 3D AudioSurround
SAOC
USAC
DRC
MP1 L2
Colourcoding
MPEG-1 MPEG-2 MPEG-4 MPEG-7
MPEG-A MPEG-B MPEG-H
MPEG-21
MPEG-C MPEG-D
GraphicsBIFS AFX ARAFOFF
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
Significant Developments Shape MPEG’s Roadmap
• The relentless increase of IP-distributed and Mobile media
• Higher quality
• More immersion media (UHD, VR, AR)
• The Internet of Media Things & Wearables
• Cloud-based media processing, storage and delivery
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)
2018 2020Jan2017
2019 2021
Internet Video Coding
IoMT
Media Orchestration
CMAF
CDVA (Video Analysis)
New codec with Lightfield
New & ImmersiveVideo Codec
Audio Wave Field Coding
AR/VR Audio extensions
Point CloudCompression
HDRTR
HDRTR 2
Omnidirectional Media Format
OMAF v2
GenomeCompression
Cloud-BasedMedia Processing
Coding
2022
Systems and Tools
Immersive Media AF
Augmented Media AF
2018 2020Jan2017
2019 2021
Internet Video Coding
Omnidirectional Media Format
IoMT
Media Orchestration
HDRTR
Audio Wave Field Coding
CMAF
New codec with Lightfield
CDVA (Video Analysis)
New & ImmersiveVideo Coding
AR/VR Audio extensions
Point CloudCompression
HDRTR 2
OMAF v2
GenomeCompression
Network-DistributedVideo Coding
Coding
2022
Systems and Tools
Immersive Media AF
Augmented Media AF
Cross-platform Media Distribution
2018 2020Jan2017
2019 2021
Internet Video Coding
Omnidirectional Media Format
IoMT
Media Orchestration
HDRTR
Audio Wave Field Coding
CMAF
New codec with Lightfield
CDVA (Video Analysis)
New & ImmersiveVideo Coding
AR/VR Audio extensions
Point CloudCompression
HDRTR 2
OMAF v2
GenomeCompression
Network-DistributedVideo Coding
Coding
2022
Systems and Tools
Immersive Media AF
Augmented Media AF
Cross-platform Media Distribution
VR360, on-demand and live (3 DoF)
2018 2020Jan2017
2019 2021
Internet Video Coding
Omnidirectional Media Format
IoMT
Media Orchestration
HDRTR
Audio Wave Field Coding
CMAF
New codec with Lightfield
CDVA (Video Analysis)
New & ImmersiveVideo Coding
AR/VR Audio extensions
Point CloudCompression
HDRTR 2
OMAF v2
GenomeCompression
Network-DistributedVideo Coding
Coding
2022
Systems and Tools
Immersive Media AF
Augmented Media AF
Cross-platform Media Distribution
VR360, on-demand and live (3 DoF)
Immersive Media with 6 Degrees of Freedom
Combining Natural and Synthetic content
MPEG-I
New MPEG project: ISO/IEC 23090 – Coded representation of immersive media5 parts currently planned 1. Architectures2. Omnidirectional Media AF3. New & Immersive Video Coding4. New & Immersive Audio Coding5. Point Cloud CodingFurther considering:6. Metadata for Immersive Services and Applications7. Metrics for Immersive Services and Applications
24 Oct 2017, Macau Third Mini-Workshop on Immersive Live Experience (ILE)