Canvas fun and beyond
0 likes950 views
The document discusses the Mozilla Corporation's implementation of WebRTC features in Firefox, particularly focusing on utilizing canvas as a video input and new functionalities for peer connections. It highlights upcoming features such as support for IPv6, audio performance improvements, and upcoming support for stereo sound and audio capture. Several sample codes and demos are provided to illustrate these features and their applications.
Canvas fun and beyond
- 1. Mozilla CorporationMozilla Corporation Canvas fun and beyond Nils Ohlmeier - Mozilla
- 2. Mozilla CorporationMozilla Corporation Regular getUserMedia
- 3. Mozilla CorporationMozilla Corporation getUserMedia sample code <video id=”preview”></video> let pc1 = new mozRTCPeerConnection(); navigator.mediaDevices.getUserMedia(constraints).then( function(mystream) { document.getElementById(“preview”).mozSrcObject = mystream; mystream.getTracks().forEach(function(track) { pc1.addTrack(track, mystream); }); }
- 4. Mozilla CorporationMozilla Corporation Canvas as video input for PC ● Firefox allows using a canvas as an input for your PeerConnection (by capturing a MediaStream from it) ● Whatever you paint onto a canvas gets streamed to the other side as video (could be recorded as well) ● Supported from Firefox 41 on (preffed off) - expected to be preffed-on in Firefox 43
- 5. Mozilla CorporationMozilla Corporation Canvas to PeerConnection
- 6. Mozilla CorporationMozilla Corporation Canvas sample code <canvas id=”painting”></canvas> let pc1 = new mozRTCPeerConnection(); let mystream = document.getElementById(“painting”).captureStream(15); mystream.getTracks().forEach(function(track) { pc1.addTrack(track, mystream); });
- 7. Mozilla CorporationMozilla Corporation Canvas as a filter
- 8. Mozilla CorporationMozilla Corporation Canvas demos https://nils-ohlmeier.github.io/webrtc-landing/canvas_demo.html https://nils-ohlmeier.github.io/webrtc-landing/canvas_filter_demo.html
- 9. Mozilla CorporationMozilla Corporation Multiple inputs for the canvas
- 10. Mozilla CorporationMozilla Corporation New WebRTC features in upcoming Firefoxes
- 11. Mozilla CorporationMozilla Corporation New WebRTC transport features Support for IPv6 (Fx 42) ● No constraint, on by default Support for ICE TCP (Fx 41) ● Support for active and passive candidates ● Currently still preffed off ● Simultaneous open supported, but preffed off Prepare for > 50 ICE candidates soon ;-)
- 12. Mozilla CorporationMozilla Corporation Upcoming audio features ● Audio perf improvements, especially on Windows (Fx41 - Fx44) ● Support for Stereo sound (target: Fx 43) ● 32KHz Audio support (target: Fx43) ● Audio capture (for screen sharing) (target: Fx43)
- 13. Mozilla CorporationMozilla Corporation More upcoming features ● Simulcast support (target: >= Fx45) ● applyConstraints() for gUM MediaStreams (target: Fx44) ● Prefs for controlling ICE candidates and createOffer/Answer hooks (Fx42) ● Removing moz prefix from PeerConnection (Fx43)
- 14. Mozilla CorporationMozilla Corporation Q & A Email: nils@mozilla.com IRC: drno in #media