kranky geek webrtc 2015 - what is mozilla doing with firefox?

Mozilla CorporationMozilla Corporation

Canvas fun and beyondNils Ohlmeier - Mozilla


Regular getUserMedia


getUserMedia sample code

<video id=”preview”></video>

let pc1 = new mozRTCPeerConnection();navigator.mediaDevices.getUserMedia(constraints).then( function(mystream) { document.getElementById(“preview”).mozSrcObject = mystream; mystream.getTracks().forEach(function(track) { pc1.addTrack(track, mystream); });}


Canvas as video input for PC

● Firefox allows using a canvas as an input for your PeerConnection (by capturing a MediaStream from it)

● Whatever you paint onto a canvas gets streamed to the other side as video (could be recorded as well)

● Supported from Firefox 41 on (preffed off) - expected to be preffed-on in Firefox 43


Canvas to PeerConnection


Canvas sample code

<canvas id=”painting”></canvas>

let pc1 = new mozRTCPeerConnection();let mystream = document.getElementById(“painting”).captureStream(15);

mystream.getTracks().forEach(function(track) { pc1.addTrack(track, mystream);});


Canvas as a filter


Canvas demos

https://nils-ohlmeier.github.io/webrtc-landing/canvas_demo.html

https://nils-ohlmeier.github.io/webrtc-landing/canvas_filter_demo.html






Multiple inputs for the canvas


New WebRTC features in upcoming Firefoxes


New WebRTC transport features

Support for IPv6 (Fx 42)● No constraint, on by default

Support for ICE TCP (Fx 41)● Support for active and passive candidates● Currently still preffed off● Simultaneous open supported, but preffed off

Prepare for > 50 ICE candidates soon ;-)


Upcoming audio features

● Audio perf improvements, especially on Windows (Fx41 - Fx44)

● Support for Stereo sound (target: Fx 43)● 32KHz Audio support (target: Fx43)● Audio capture (for screen sharing) (target:

Fx43)


More upcoming features

● Simulcast support (target: >= Fx45)● applyConstraints() for gUM MediaStreams

(target: Fx44)● Prefs for controlling ICE candidates and

createOffer/Answer hooks (Fx42)● Removing moz prefix from

PeerConnection (Fx43)


Q & A

Email: [email protected]: drno in #media

mailto:[email protected]


Links



http://output.jsbin.com/cuvocu/

https://hacks.mozilla.org/2015/09/controlling-webrtc-peerconnections-with-an-extension/

http://mozillamediagoddess.org/2015/09/10/webrtc-privacy/












kranky geek webrtc 2015 - what is mozilla doing with firefox?

Technology