Daala project
- Recording and Transcript: http://www.voicebase.com/autonotes/private_detail/3984773/hash=bJ2dZGtsaZdsa5nGw5Vmm2qTZnBo
- Presentation Slides: https://www.dropbox.com/s/kdqeiiurfdsp519/daala.pdf?dl=0
- Ongoing IP challenges
- Replacing heavily patented technology with alternative encoding optimization
- No more residual analysis, but PVQ
- Pre and post filter combination to prevent block artifacts
- Filter advantages around quality and efficiency, but disadvantage in complexity and isolation of processing (lap transforms)
- Decision model no longer a serialized binary decision stack but a parallel 4 binary model
- Not yet on-par with HEVC
- Expected time to market yet unknown, submitted to IETF
- Not hardware compatible with existing hardware encoding/decoding
- http://xiph.org/daala/ -- follow up here.
Action items:
- Over the next year will be more opportunity for broader community involvement and industry support.
Accessibility
- 3 or 4 accessibility focused players ( https://github.com/paypal/accessible-html5-video-player, http://terrillthompson.com/ableplayer/ , http://www.accessibilityoz.com/ozplayer/, https://github.com/nomensa/Accessible-Media-Player)
- Robust support for accessibility
- FCC regulations
- Broadcast video with captions over 3 min, must support captions
- Color font -face , background color opacity of captions, placement
- 608 rules around regions
- http://hraunfoss.fcc.gov/edocs_public/attachmatch/FCC-12-9A1.pdf
- http://www.jwplayer.com/blog/implementing-fcc-closed-captioning-mandates/
- Twenty-First Century Communications and Video Accessibility Act of 2010 (CVAA)
- W3C? requirements: http://www.w3.org/WAI/PF/media-a11y-reqs/
- VTTjs? ( from Mozilla ) https://github.com/mozilla/vtt.js
- Descriptive audio track (track kind=description)
- Discountability of keyboard shortcuts ? ( localize? )
- flash does not allow programmatic fullscreen
- kaltura keyboard shortcuts: -- http://player.kaltura.com/modules/KalturaSupport/tests/KeyboardShortcuts.html
- JW default shortcuts: http://support.jwplayer.com/customer/portal/articles/1597259-keyboard-shortcuts
- http://kgit.html5video.org/pulls/1174/modules/KalturaSupport/tests/Aria.html - demo voice control (Chrome)
- What's supported in each browser: http://html5accessibility.com/ ?
- Native support in browsers for text to speech.
- Support in screen readers to turn it off.
- Screen readers survey: http://webaim.org/projects/screenreadersurvey2/
- Define accessible player.
- break the able plater google sheet to an open report: https://docs.google.com/spreadsheets/d/1QJVcXx5hTWYBcJbHJD3DrL3hSFVbfy1VQFyADMtrDFY/edit#gid=0
- How to make players accessible ( not just reference examples )
Action Items:
- Get Siliva involved;
- Form group to push forward on programmatic validation!
Second Screen
- JWPlayer? demo: http://demo.jwplayer.com/chromecast/
- W3C? Web & TV group: http://www.w3.org/2011/webtv/
- Second W3C? Web and TV Workshop: http://www.w3.org/2010/11/web-and-tv/
- http://www.w3.org/2011/webtv/wiki/Home_Network_TF_Requirements
- How can we encourage smart TV to be more like chromecast?
- have a browser on the second screen.
- discovery is tricky
- Dial protocol? http://www.dial-multiscreen.org/
- getting browsers involved.
- “open source unified multi screen casting library” - maybe write an interface wrapper of multiple sdks across multiple platforms
- Maybe reach out to:
- http://www5.ballstreams.com/devices
- http://www.smarttv-alliance.org/About/OurMission.aspx
- chromecast sdk
- second screen applications:
- silent tv; multiple audio per device
- multiple captions per device
Action items:
- Support HTML5? on big screens / reciver apps.
- Review creation of consolidated casting library.
- Propose dial protocol includes support for feature detection.( what codecs it can play etc )
Adaptive Streaming
- Stage of dash.js adoption;
- performance version of dash.js? ( small )
- making the core smaller.
- Mozilla focused on MSE to ship ( less focused on video metrics )
- https://wiki.whatwg.org/wiki/Video_Metrics
- would be great to consolidate these.
- video analytics:
- what happens until the data gets delivered and what happens in the player itself.
- Buffer ranges; MSE rough bandwidth calculations “good enough” ?
- Video tag vs browser based implementation.
- Multi-track audio apple story introduced in iOS 7.2 and broke in 8.0
- is Dash.js sufficient??
- google shaka player -- https://github.com/google/shaka-player
- bitdash -- http://www.dash-player.com/
- Rate adaptation for dynamic adaptive streaming over HTTP - academic paper describing proposed adaptive metrics
- Interchangeable adaptive component.
- What is the current status of IPR ? ( intellectual property rights )
- 85% of ads still going through flash.
Action Item
- Video_Metrics could use a refresh. very relevant for dash.js work today.
Live Streaming
- p2p and
- icecast pure http streaming server.
- isn’t recommended for low-latency (<10s) due to http.
- Limitations mostly attributed to client buffers
- wowza http streaming server.
- Live vs WebRTC?
- sporting events vs video conferencing .. or hangout broadcast.
- Push HLS s3 lower latency; akamai has larger latency.
- yes you can go low latency with icecast
- but you need to control pipeline down to the player ( network )
- Define “low latency”
- You can skip to latest by having a 404 segment.
- people trying to use dash.js for live streaming ;)
- Reach to devices
- Europe about the specs
- Left with both DASH and HLS.
- ‘not that bad’
- Lower quality audio streams help with low latency by having low network bandwidth fallback.
- Dash.js don’t play out of sync content.
- Some references:
- SNTP considered harmful
- Causes time discontinuity, breaks streams
- Use proper NTP
- Server side Ad stitching ( events cuePoints, id3 tags, VAMP xml events )
- 3 headed: streaming server catch the cueTones
- convert cueTones to respective packing live protocols
- include service or player integration to pick up on packaged VAST definitions or consume out-of band service if player does not make cuePoints available to the player ( id3 tag ) for safari OSX. or iOS safari.
Action Items:
- wowza to implement webRTC ingest.
- investigate “low latency mode” for HTTP streaming.
- interoperability for ad timing effort. ( VAST / VMAP / Live Ad Stitching )
- follow up offline on ad timing -- kaltura, wowza, jw, icecast etc.
- VAST updates -- visibility metrics? should add events ?
- being discussed in IAB standard groups.
- encourage.
JavaScript? based delivery
- Recording and transcript: http://www.voicebase.com/autonotes/private_detail/3984821/hash=bJ2dZGxnZ5dsa5nGw5ZhnXHFbZ1r
- Presentation slides: https://www.dropbox.com/s/apof88dc1ltu71v/javascript-based-delivery.pdf?dl=0
https://www.theoplayer.com - JS HLS
- Theo Player hacks to swap video tags, which is supported on many platforms
- Peer5 - p2p wrapper around XHR, or an “aggressive” replacer
- Standard bridge between Flash and JavaScript?
- Progressive MP4? via MSE
- Control of buffer
- QoS? metrics
- mp4box.js - waiting for implementations and requests for improvement
- MSE+HLS by video.js
- video.js to move to MSE by default instead of Flash
- Mobile implementations - questionable if JS will dominate, although there is preference to maintain js logic across different platforms (JWPlayer?, videojs)
DRM
- CENC common encryption.
- castlabs impressive player
- wowza working on it; shares common encryption logic with playReady effort.
mixed content issues ( fixed? )