JVET-AG0182 AHG9: JPEG segments SEI message [P. de Lagrange, D. Doyen, E. François, F. Urban, C. Salmon-Legagneur (InterDigital)]
During the 32nd JVET meeting, the contribution JVET-AF0141 proposed new SEI messages to embed externally defined camera-related metadata structures (JFIF, EXIF or XMP). This is said to provide somewhat redundant functionality, with EXIF additionally raising concern because of the need to refer to specifications from non-SDO bodies like CIPA and JEITA. This contribution proposes to replace or merge the JFIF SEI message with a new SEI message embedding generic JPEG segments, that is said to go around these issues while providing more functionality. Indeed, some JPEG segments named “APP segments” are free to use for applications with any kind of payload and are commonly used to embed such camera-related metadata. This solution is also reported to offer additional possibilities such as embedding full JPEG pictures in a video bitstream, for instance for indexing purpose or hi-resolution snapshots.
A comment was made that the statement about “redundant functionality” about JFIF, EXIF, XMP is not really true.
Another comment was made that this significantly deviates from the original intent of SEI messages, which should not be seen as yet another transport mechanism. JPEG segments may contain something that has no relation at all with the video (other than the thumbnails in JFIF).
If the intent was to find a way to resolve the EXIF referencing problem, this should not be resolved by allowing lots of other elements to come into SEI messages.
No action on JVET-AG0182