Web3D Consortium Overview and AR Initiatives

AR Standards Community Meeting

February 1, 2013

Anita Havele

Executive Director, Web3D Consortium

Anita.Havele@web3d.org

About Web3D Consortium

Founded in 1997. We are an International, non-profit, member-funded, industry group. Our members span from business, academia, government and the

military. We maintain a royalty-free, ISO standard for web based 3D.

Our standard - X3D (Extensible 3D)

Originated from VRML and now in XML

Certified Standard

Extensible, Interoperable & Multi Platform

Open and Royally Free 3D solution for the Web

3D Authoring File Format

Run-Time Engine

• 3D file format specification: Designed for reuse of content and is archivable

• Run-time player specification: Compatible with

many 3D technologies

• Extensible: Components can be added to extend

functionality to applications and services

• Profiled: Standardized sets of extensions to meet

specific application needs.

(Interchange, Interactive, Immersive)

• Interoperable: Between applications and platforms

• Evolutionary: Easy to update and preserve

• Real-Time Animation: Graphics are high quality, interactive, and include audio and video

• Well-Specified: Makes it easier to build conformant, interoperable, consistent implementations

• Royalty Free and ISO Certified: ISO SC-24/WG 6

www.web3d.org

: the Standard for Scene Graph

• Multiple encodings

• Compressed Binary

• XML

• Classic VRML

• Multiple API’s

• ISO ECMAScript

• Java

Scene graph for real-time interactive 3D

Delivery of virtual environments over the web

Event ROUTE

Slide 7

16 January 2013

X3D Specifications

X3D an event and runtime model build for the Web

X3D Specification

.x3dv

ClassicVRML

Encoding

ISO 19776-2

.x3db

Binary

Encoding

ISO 19776-3

.x3d

XML Encoding

DTD, Schema

ISO 19776-1

Scene Access

Interface (SAI)

ECMAScript

ISO 19777-1

Scene Access

Interface (SAI)

Java

ISO 19777-2

X3D

Abstract, API

Specifications

ISO 19775-1,2

DICOM

H-Anim

.wrl, .wrz

VRML 97

Specification

ISO 14772-2

DOM

Document

Object Model

Recommendations

W3C

XML

Encryption,

Authentication

Recommendations

W3C

X3D File

Encodings

Programming

Language

Bindings © 2007, Daly Realism & Don Brutzman

And supported by these standards development organization

X3D Development

X3D Earth

H-Anim

AR

X3D WG

& Web3D

Board

ISO SC24/WG6

Medical

Special Interest Groups

E-learning

Working Groups

Dec3D CAD

Web3D Liaison Relationships

ISO

SC24

Khronos

W3C OGC

SC29 Web3D Consortium

WG 6 X3D & others

WG 9 ARC

open door to individuals

IPR RF

IPR RF RAND

patents

IPR RF RAND

Member protection

only

IPR

IPR RAND patents

IPR RF

Players 9 Active player codebases

23 known implementations

11 Open Source, 12 Commercial

Editors 5 authoring tools

conversion tools

Collada -> X3D Pipeline

Playback Devices Web Browsers

Standalone / Applications

CAVES, Walls, Domes

Cell Phones

Augmented Reality

X3D: Extensible 3D Graphics for Web Authors

x3dgraphics.com website Includes course slide sets, examples, videos

http://x3dgraphics.com/slidesets

http://x3dgraphics.com/examples/X3dForWebAuthors

Resources on X3D Players, Editors, Applications and more available at: http://www.web3d.org/x3d/content/examples/X3dResources.html

Gaming

Augmented Reality

Mirror Worlds

Data Visualization

Enterprise Medical

Cultural Heritage

E-commerce

Virtual Worlds

Education

Slide 15

16 January 2013

Industry and Government Adoption

It is open source, free, and royalty-fee (you own your content!)

Interoperable between applications and platforms

Longevity - Content stands the test of time

Web3D Member Benefits • Early access to the standard • Contribute to the Working Groups towards the development of X3D

specifications • Participate in the development of Conformance Suites • Partner in Web3D Proposals • Collaborate with other Standards Organizations • A marketing platform for your Product and Research Projects • Joint Press Releases • Co-Market with the Web3D consortium at conferences and workshops • Network with leading experts in Web3D technology

Membership Levels: Organization, Professional and Student To Join please visit: www.web3d.org/join

Web3D 2013 Activities • X3D Version 3.3

• X3DOM

• X3D AR/MR

• X3D Medical

• 3D Compression

• 3DPIE Project(OGC)

• Web3D 2013 Conference

• SIGGRAPH 2013

X3D Version 3.3

• Specifications (All ISO/IEC)

– Abstract

– Encodings (XML, Compressed Binary, ClassicVRML)

– Language Bindings

• New Features

– Volume Visualization (Medical support)

– Clarification/upgrade of GeoSpatial

– Improvement to the DIS component

– User-defined units for better control of precision

– Medical Interchange profile

X3DOM • HTML5 specification allows 3D models to be

displayed in the browser

• This allows for 3D without plugins

• X3DOM (“X-freedom”) – open source JavaScript X3D player

• Developed by Web3D member Fraunhofer

• X3DOM available with Firefox, Chrome, and Safari

• X3DOM is open source is available at www.x3dom.org

• CAD Working group providing NURBS in X3DOM

• X3DOM to be included in the X3D specification V3.4

• X3DOM submitted to W3C for Declarative 3D

Extending X3D for AR

AR Continum (ARC)

Real Environment

Augmented Reality

Virtual Reality

Virtual Environment

Mixed Reality

Existing

X3D Nodes

New X3D

Nodes for AR

Address the larger “2D + 3D” space for AR

Go beyond basic geo-location based AR

X3D AR Applications Today

Real Environment

Augmented Reality

Virtual Reality

Virtual Environment

Mixed Reality

http://www.bitmanagement.de/en/products/mobile/ios

X3D Mixed-Reality Continuum: WG Plans

Continue adoption and support of X3D models in AR applications

Continuing work with ISO SC-24 WG9 implementing the AR Reference Model

Extensible to existing frameworks Extend X3D Scenegraph to implement AR Use KML, OpenGIS, ARML, X3DOM, …

General/Flexible Device/platform independence (mobile, desktop and HMD) Sensors and devices for vision, marker, and location

X3D-AR Requirements and Proposal

• Supporting image (camera) sensors • Live video • Background and textures • Tracking camera motion • Camera calibration

Fraunhofer and Korea Chapter proposals currently in the final state of merger

Modification of one node and three new nodes are proposed • ViewPoint node • CalibratedCameraSensor • TrackingSensor • Backdrop

http://web3d.org/wiki/index.php/X3D_and_Augmented_Reality

Open for public comments until March 31, 2013

X3D AR Proposal Details CalibratedCameraSensor and TrackingSensor nodes

• Device independent on end-user side

• Delegating specific device setup to browser/user

Reusing PixelTexture node

Backdrop node for background

• Independent from viewpoint orientation

• Naming following Fraunhofer’s proposal

Minimal extension to Viewpoint node

• Subset of Fraunhofer proposal

• Camera calibration information to come from sensor nodes

http://web3d.org/wiki/index.php/X3D_and_Augmented_Reality

Open for public comments until March 31, 2013

AR Medical Application

Why 3D?

Avoiding invasive procedures

Cardiac CT Angiography

CT colonography

Surgical pre-planning

Orthognathic surgery

Hepatic surgery

Improved diagnosis

Better imaging of anatomy

Imaging Modalities

CT MRI fMRI Ultrasound PET scan DTI

Web3D Medical WG

Reproducible rendering for throughout the healthcare enterprise

• An n-D Presentation must include:

–Structured and interactive virtual environment display

(2D & 3D objects and time series)

– Platform-independent, royalty-free technology to enable vendor innovation

– Can be rendered with or without stereoscopy

– Openly-published

X3D Volume Rendering

- Necessary and Sufficient node set for industry’s Greatest Common

Denominator:

- Volume Component: render styles

- X3D version 3.3

•Two independent implementations:

–www.h3d.org

–www.instantreality.org

Clipping Planes are already specified in X3D 3.2 Rendering Component

X3D and Medical

X3D Volume Rendering

Composable Render Styles covering the state of the art

Formalizes parameters and transfer functions for 3D rendering & blending

Opacity Map Silhouette Cartoon

Assign different RenderStyles to different segments, blend two volumes

X3D and Medical Future Work • Validation, conformance and spec language • MPR implementation • Curved MPR implementation

Goal is to compress and stream 3D assets using a effective and widely

adopted coder – decoder (codec).

A Standard 3D Compression Format? Similar to MP3, H.264, JPEG

Audio Video Images 3D

MP3 H.264 PNG/JPEG X3D, MPEG4, COLLADA

Napster YouTube Facebook ?

3D standard formats available today

• X3D (Web3D Consortium)

• MPEG4 (ISO SC29)

• Collada (Khronos)

What’s available today?

Multi-SDO Collaboration

• Cooperative design and approval

• Leveraging existing technologies

• Mapping Nodes from X3D, MPEG4 and COLLADA

• Liaison Working Group relation with an MOU

• Royalty Free Solution

3D Compression Initiatives

• X3D Binary Compression

• MPEG 3D Mesh Progressive

• Streaming (3DMC),

• Bones Based Animation (BBA)

• Google Body compression –

• Delta and ZigZag encoding

• FHR image compression

Each SDO ratifies specification to be

royalty free and publicly distributes

LWG

LWG open to all

SDO Members

Liaison WG drafts

specification

LWG sends draft spec to

each SDO for ratification

Multi –SDO relationship Liaison working Group (LWG)

Web services approach?

RESTful APIs–Query and negotiate what compression and streaming

capabilities are available

For a standard 3D codec for compressing and streaming.

What 3D assets to include?

• Scenegraph,0

• geometry,

• textures,

• materials,

• animations… and ???

0

Present-day Discussions

Challenges of defining efficient codecs for compressing and streaming 3D assets

• 3D is more complex

• 3D has many facets

• 3D has diverse asset types

• 3D has varied use cases

X3D – 3D Compression Format

OGC 3DPIE and X3D

• X3D aligns with OGC 3D visualization goals

• 3D Portrayal Interoperability Experiment

3D Portrayal SWG participation

• Web3D Member Contributions • Virginia Tech – 3D Blacksburg Project

• Bitmanagement – BS Contact Browser

• Fraunhofer – Instant Reality Browser

• MBARI – Sensor data underwater visualization

• NPS – X3D Earth Project

Web3D Consortium Goals Overall Goals

• Advance X3D while retaining max backward compatibility

• Retain ability to develop standalone browsers ( e.g. XJ3D)

• Filling in missing infrastructure

New features

• Annotation component

• Enhancements to Geospatial components General Spatial processing

• Generalized spatial sensor component

• Features to better support AR/Mobile Profile

• Enhance Metadata

• Interactive medical application requirements

• Haptics

Next-generation X3D: parallel tracks

X3D version 3.4 – extend existing capabilities

• Stable addition of further component capabilities

• Projective texture mapping, metadata annotations, humanoid animation, CAD interoperability, others

Compressed binary encoding improvements • Call for Contributions release expected March 2013

• Geometric compression, pipelining, EXI binary, etc.

X3D version 4.0 – evolution • HTML5, Declarative 3D, X3DOM techniques, mobile • AR changes, event model extensions, if needed

Upcoming Events

Web3D 2013 Conference www.web3d2013.org

20-22 June 2013 in San Sebastian, Spain

SIGGRAPH 2013 http://s2013.siggraph.org/

21-25 July 2013, Anaheim Convention Center, California

Come visit us in booth 233 on the show floor

Several Birds of the Feather sessions from 22-25 July, 2013

Web3D 2013 Conference

• Co-sponsored by Web3D Consortium, ACM SIGGRAPH and Eurographics

Highlights current Capabilities and trends in interactive 3D graphics.

Call for Papers - 11 March, 2013 Workshops and Tutorials - 15 April, 2013

• Several Workshops and Tutorials Augmented Reality 3D Compression

www.web3d2013.org 20-22 June 2013 in San Sebastian, Spain

Looking forward to participation from the AR Community

Contact the Web3D Consortium

Visit us at: www.web3d.org

To Join: www.web3d.org/join

Executive Director: Anita Havele

Email: Anita.Havele@web3d.org

Web3D Consortium

Castro Street, Suite #120-490

Mountain View, CA 94041, USA

Phone: +1 248 342 7662

Fax: +1 248 457 8018