JVET-AM0179 AHG9: Depth-aware optimization for Encoder optimization information SEI message [G. Teniou, S. Wenger, A. Hinds (Tencent)]

This document proposes a new eoi_type associated to depth-aware encoding optimization. The corresponding metadata is meant to guide the decoder in selecting appropriate filters, apply background removal or activate specific player adaptations such as local backlight modulation, semantic segmentation…

A potential use case described was when depth was available to the encoder which was used to preserve the foreground. The proponent said that the decoder might use the information about the source of the depth in an immersive use case.

Editors should check the TuC to remove unnecessary yellow highlights.

It was noted that the EOI SEI already has an object based optimization type, and suggested that depth-based processing may be expressed using that eoi type.

It was suggested that the proposed wording of the EoiDepthAwareFlag could be better described and more concise.

It was questioned why the decoder would benefit from the information regarding the depth source type and the depth-aware encoding method used.

It was noted that the depth map presence, bit depth, and resolution are already available elsewhere, and there is no information provided of which layer contains the depth.

It was noted that many of the existing optimizations in EOI were studied in AHG8.

It was noted that the signalled information doesn’t describe what depth range is prioritized, e.g. foreground vs background.

It was suggested that having some more information such as a metric to indicate for example what QP was used to code foreground vs background. Quality and sharpness information may be useful for the rendering side.

It is unclear how a receiving system would make use of the signalled information.

Further study encouraged to make more clear the intended use cases and ensure that the signalled information would be used by the receiving system to address the use cases.

Digitally signed content messages (4)

Contributions in this area were discussed during 1820–2000 on Saturday 28 June 2025 (chaired by J. Boyce).