Home

Welcome to the mp4box.js wiki!

Use cases

ISOBMFF read-only:

• simple box analysis (e.g. http://download.tsi.telecom-paristech.fr/gpac/mp4box.js/filereader.html)
  • users: dash.js (https://github.com/Dash-Industry-Forum/dash.js)
• provide MSE helper functions
  • RFC6381 about codecs
• more complex use case cases:
  • sample extraction (fragmented or not modes)
    • users:
      • extraction of TTML samples (to be processed by another library)
      • extraction of HEVC frames for BPG image visualization
  • metadata extraction
    • users: research issues such as transport of Flash games

ISOBMF read-write:

• on-the-fly fragmentation
  • especially non-fragmented, fast start ('moov' before 'mdat')
  • non-fragmented, no fast start
  • users: P2P

Requirements

• Browsers compatibility (IE10+, FF, Chrome, Safari)
• Node compatibility
• Should handle Large files (tested 7+GB)
• Should be input delivery independant
  • XHR (Node, Browser)
  • File (Node, Browser)
  • P2P
  • "Stream"
    • Progressive
    • W3C Streams API

Code

Structure

• 10+ JS files
• API is callback based
  • sometimes also promises based? (when?)

Architecture

MP4Box.js is fed with ArrayBuffer by the application. MP4Box.js is agnostic with the media it is fed, although it has expectations from its API (in particular the data is expected to be a remote ISOBMF file).

+===============+===========================================================+
| Application   |                                                           |
+===============+===========================================================+
| MP4Box.js API | append() / SetExtractOptions() / Flush() / ...            |
+===============+===========================================================+
| MP4Box.js     | ISOFile: API                                              |
| MP4Box.js     |    MPEG4 'esd' / Box read | Box write / Sample management |
| MP4Box.js     | Data: ArrayBuffer abstract by: DataView or DataStream     |
| MP4Box.js     |                                or MultiByte Stream        |
+===============+===========================================================+
| Network       |                                                           |
| (controlled   |  Protocol independent: XHR, WebRTC DataChannel, File      |
| by the        |    => Stream API                                          |
| Application)  |                                                           |
+===============+===========================================================+

API

TODO

Build

• Grunt
  • tasks: concatenate, uglify, code quality
  • MP4Box;js "simple" and "full" (see above)

Tests

• QUnit
  • no MSE coverage (pass a buffer through MSE and check result - would help is regression in MSE)
  • many tests: extraction, buffer overlaps, ...
  • tests on box
• automatic
  • Node
  • Browser
    • Headless PhantomJS wouldn't work (TODO: retry)
• TODO: isomorphic when serializing to JS then re-writing boxes
• Performances:
  • DataView is right but slow: https://groups.google.com/forum/#!searchin/dashjs/dataview/dashjs/5PmEkjKILDQ/bPVw4YDIS3kJ
  • Network evaluation (from offsets returned by the API): TODO
    • continuous data, box-aligned
    • continuous data, non box-aligned
    • non continuous data, non box-aligned

Problems

• Workers / Concurrency
• Re-entrency / Thread-Safety
• Should return box size + 8

Future

• Separate MP4Box.js "Simple" and "Full" and remove datastream.js (which is big) from "Simple"
• Use ES6 (Classes, 'let' instead of 'var', ...)
  • dash.js plans to move to ES6
  • binders in Grunt to generate ES5 from ES6