Back to Search Document details
32nd Meeting: Hannover, DE, October 2023 2023-10-12 22:47
JVET AHG report: SEI message studies (AHG9)
Authors: Sean McCarthy Ye-Kui Wang Takeshi Chujoh Sachin Deshpande Chad Fogg Hendry Philippe de Lagrange Gary J. Sullivan Alexis M. Tourapis S. Wenger Jens-Rainer Ohm
Abstract
This document summarizes the activity of AHG9 (SEI message studies) between the 31st JVET Meeting (Geneva, CH, 11–19 July 2023) and the 32nd JVET Meeting (Hannover, DE, 13–20 October 2023).
Meeting Notes
JVET-AF0009 JVET AHG report: SEI message studies (AHG9) [S. McCarthy, Y.-K. Wang (co-chairs), T. Chujoh, S. Deshpande, C. Fogg, Hendry, P. de Lagrange, G. J. Sullivan, A. Tourapis, S. Wenger (vice-chairs)]

Related contributions

A total of 42 contributions were identified relating to the mandates of AHG9. Some contributions also relate to the work of AHG8.

The number of contributions relating to each AHG9 mandate is as follows (some contributions relate to more than one mandate):

  • 10 contributions relate to the mandate to study the SEI messages in VSEI, VVC, HEVC, and AVC.
    • 8 contributions relate to SEI processing order SEI message aspects other than post-processing filter (PPF) grouping
    • 2 contributions relate to SEI messages related to film grain synthesis
  • 24 contributions relate to the mandate to discuss the document for the TuC for future extensions of VSEI.
    • 3 contributions relate to the general direction of grouping of PPFs, including NNPFs
    • 9 contributions relate to detailed aspects of NNPF grouping
    • 6 contributions relate to the source picture timing information SEI message
    • 4 contributions relate to the encoder optimization information SEI message
    • 2 contributions relate to the object mask information SEI message
  • 2 contributions relate to the mandate to collect software and showcase information for SEI messages;
  • 13 contributions relate to the mandate to identify potential needs for additional SEI messages.
    • 4 contributions relate to SEI messages related to generative video
    • 9 contributions relate to other SEI messages
  • 1 contribution relates to the mandate to study the alignments of the same SEI messages in different standards.

The following is a list of contributions related to the mandates of AHG9.

Study the SEI messages in VSEI, VVC, HEVC and AVC

AHG9: SEI processing order SEI message aspects other than PPF grouping (8)

  • JVET-AF0049 AHG9: On the SEI processing order SEI message [M. M. Hannuksela (Nokia)]
  • JVET-AF0061 AHG9: On grouping of post-processing filters [Y.-K. Wang, W. Jia, J. Xu, L. Zhang (Bytedance)]

JVET-AF0061 also relates to the mandate to discuss the TuC for future extensions of VSEI.

  • JVET-AF0062 AHG9: Some syntax and semantics changes for the SEI processing order SEI message [Y.-K. Wang (Bytedance)]
  • JVET-AF0065 AHG9: On the SEI processing order SEI message (Part 1) [L. Chen, O. Chubach, Y.-W. Huang, S. Lei (MediaTek)]
  • JVET-AF0067 AHG9: On the SEI processing order SEI message (Part 2) [L. Chen, O. Chubach, Y.-W. Huang, S. Lei (MediaTek)]
  • JVET-AF0070 AHG9: On the SEI processing order SEI message [T. Chujoh, Y. Yasugi, T. Ikai (Sharp)]
  • JVET-AF0174 AHG9: On the SEI processing order SEI message and NNPF groups [Y. Sanchez, C. Hellge, T. Schierl (Fraunhofer HHI)]

JVET-AF0061 also relates to the mandate to discuss the TuC for future extensions of VSEI.

  • JVET-AF0189 AHG9: Proposed modifications of the draft SEI processing order SEI message in VVC [G. J. Sullivan, S. McCarthy, P. Yin (Dolby Labs)]

AHG9: SEI messages related to film grain synthesis (2)

  • JVET-AF0142 [AHG9] Local Film Grain Synthesis using Annotated Regions SEI [G. Teniou, S. Wenger (Tencent)]

JVET-AF0142 also relates to the mandate to identify potential needs for additional SEI messages.

  • JVET-AF0144 [AHG9] Adaptive Film grain synthesis using Alpha Channel Information SEI message [G. Teniou, S. Wenger (Tencent)]

JVET-AF0144 also relates to the mandate to identify potential needs for additional SEI messages.

Discuss the document for the TuC for future extensions of VSEI

AHG9: General direction of grouping of post-processing filters (PPFs), including NNPFs (3)

  • JVET-AF0050 AHG9: On NNPF groups [M. M. Hannuksela, F. Cricri (Nokia)]
  • JVET-AF0061 AHG9: On grouping of post-processing filters [Y.-K. Wang, W. Jia, J. Xu, L. Zhang (Bytedance)]

JVET-AF0061 also relates to the mandate to study SEI messages in VSEI, VVC, HEVC and AVC.

  • JVET-AF0174 AHG9: On the SEI processing order SEI message and NNPF groups [Y. Sanchez, C. Hellge, T. Schierl (Fraunhofer HHI)]

JVET-AF0174 also relates to the mandate to study SEI messages in VSEI, VVC, HEVC and AVC.

AHG9: Detailed aspects of NNPF grouping (9)

  • JVET-AF0050 AHG9: On NNPF groups [M. M. Hannuksela, F. Cricri (Nokia)]
  • JVET-AF0051 AHG9: Signalling the gain provided by NNPFs and NNPF groups [M. M. Hannuksela, F. Cricri, A. Hallapuro (Nokia)]
  • JVET-AF0067 AHG9: On the SEI processing order SEI message (Part 2) [L. Chen, O. Chubach, Y.-W. Huang, S. Lei (MediaTek)]

JVET-AF0067 also relates to the mandate to study SEI messages in VSEI, VVC, HEVC and AVC.

  • JVET-AF0091 [AHG9] On design for signalling purpose information for NNPFGC [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0092 [AHG9] On the output pictures from NNPFGC with parallel grouping type [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0093 [AHG9] On intermediary output picture(s) from activation of an NNPFGC [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0094 [AHG9] On activation of an NNPFGC that contains another NNPFGC [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0095 [AHG9] On order of output pictures when skipped candidate input pictures are present in NNPFGA [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0096 [AHG9] On miscellaneous aspects of NNPFGC and NNPFGA [Hendry, J. Nam, S. Kim, J. Lim (LGE)]

AHG9: Source picture timing information SEI message aspects (6)

  • JVET-AF0055 AHG9: On Source Picture Timing Information (SPTI) SEI message [J. Samuelsson-Allendes, S. Deshpande (Sharp)]
  • JVET-AF0069 AHG9: On source picture timing information SEI message [S. McCarthy, G. J. Sullivan, P. Yin (Dolby)]
  • JVET-AF0097 [AHG9] On description of picture 0 in source picture timing information SEI message [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0098 [AHG9] On temporal reversal feature in source picture timing information SEI message [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0099 [AHG9] On signalling of source picture interval scale factor and sublayer synthesized flag in source picture timing information SEI message [Hendry, J. Nam, S. Kim, J. Lim (LGE)]
  • JVET-AF0100 [AHG9] On miscellaneous aspects of source picture timing information SEI message [Hendry, J. Nam, S. Kim, J. Lim (LGE)]

AHG9: Encoder optimization information SEI message aspects (4)

  • JVET-AF0052 AHG9: Proposed updates on the encoder optimization information SEI message [M. M. Hannuksela, F. Cricri (Nokia)]
  • JVET-AF0068 AHG8/AHG9: Signalling of encoder preprocessing information [W. Jia, Y. Li, Y.-K. Wang, K. Zhang, L. Zhang (Bytedance)]
  • JVET-AF0105 AHG9: On colour vision deficiency optimization type for encoder optimization info SEI message [C. Kim, Hendry, D. Gwak, J. Lim, S. Kim (LGE)]
  • JVET-AF0107 AHG9: On miscellaneous aspects for encoder optimization info SEI message [C. Kim, Hendry, D. Gwak, J. Lim, S. Kim (LGE)]

AHG9: Object mask information SEI message aspects (2)

  • JVET-AF0087 AHG9: Experimental results of object mask auxiliary picture coding [Z. Zhang, J. Chen, Y. Ye, S. Wang (Alibaba)]
  • JVET-AF0088 AHG9: Software implementation and further fixes of the object mask information SEI message [J. Chen, Z. Zhang, Y. Ye, S. Wang (Alibaba)]

JVET-AF0088 also relates to the mandate to collect software and showcase information for SEI messages.

Collect software and showcase information for SEI messages

  • JVET-AF0088 AHG9: Software implementation and further fixes of the object mask information SEI message [J. Chen, Z. Zhang, Y. Ye, S. Wang (Alibaba)]

JVET-AF0088 also relates to the mandate to discuss the TuC for future extensions of VSEI

  • JVET-AF0167 AHG9: On the Proposed Multiplane Image Information SEI Message [T. Lu, P. Yin, S. Oh, S. McCarthy, W. Husak, G. J. Sullivan (Dolby)]

JVET-AF00167 also relates to the mandate to identify potential needs for additional SEI messages.

Identify potential needs for additional SEI messages

AHG9: SEI messages related to generative video (4)

  • JVET-AF0048 A Study on Decoder Interoperability of Generative Face Video Compression [B. Chen, S. Yin, J. Chen, Y. Ye (Alibaba), S. Wang (CityU HK)]
  • JVET-AF0145 AHG9: SEI message for text for generative AI [A. Hinds, S. Wenger (Tencent)]
  • JVET-AF0146 AHG9: On Face Motion Information for Generative Face Video [H.-B. Teo, J.-Y Thong, K. Jayashree, C.-S. Lim, K. Abe (Panasonic)]
  • JVET-AF0234 AHG9: Common text for proposed generative face video SEI message [B. Chen, S. Yin, J. Chen, Y. Ye (Alibaba), S. Wang (CityU HK), S. McCarthy, P. Yin, G.-M. Su, A. K. Choudrhury, W. Husak, G.J. Sullivan (Dolby)]

AHG9: Other SEI messages (9)

  • JVET-AF0138 AHG8/AHG9: Truncated bit depth support SEI messages [D. Ding, X. Zhao, S. Liu, G. Teniou, S. Wenger (Tencent)]
  • JVET-AF0140 [AHG9] Inter Picture Dependency SEI message [G. Teniou, S. Wenger, S. Liu (Tencent)]
  • JVET-AF0141 AHG9: SEI messages for common image metadata formats [A. Hinds, S. Wenger (Tencent)]
  • JVET-AF0142 [AHG9] Local Film Grain Synthesis using Annotated Regions SEI [G. Teniou, S. Wenger (Tencent)]

JVET-AF0142 also relates to the mandate to study SEI messages in VSEI, VVC, HEVC and AVC.

  • JVET-AF0144 [AHG9] Adaptive Film grain synthesis using Alpha Channel Information SEI message [G. Teniou, S. Wenger (Tencent)]

JVET-AF0144 also relates to the mandate to study SEI messages in VSEI, VVC, HEVC and AVC.

  • JVET-AF0147 AHG8/AHG9: On Picture Modality Type [J. Gao, H.-B. Teo, C.-S. Lim, K. Abe (Panasonic)]
  • JVET-AF0148 [AHG9] Large SEI message signalling [G. Teniou, S. Wenger (Tencent)]
  • JVET-AF0149 [AHG9] Application-required SEI NAL Units [G. Teniou, S. Wenger (Tencent)]
  • JVET-AF0167 AHG9: On the Proposed Multiplane Image Information SEI Message [T. Lu, P. Yin, S. Oh, S. McCarthy, W. Husak, G. J. Sullivan (Dolby)]

JVET-AF00167 also relates to the mandate to collect software and showcase information for SEI messages.

Study the alignments of the same SEI messages in different standards

  • JVET-AF0045 AHG2/AHG9: On the use of NNPF SEI messages in AVC [M. M. Hannuksela (Nokia)]

Activities

The regular JVET e-mail reflector was to be used for discussions (jvet@lists.rwth-aachen.de) with [AHG9] in message headers. However, there were no emails sent to the JVET reflector during the AHG period with [AHG9] in the message header.

Recommendations

The AHG recommended to:

  • Review all related contributions; and
  • Continue SEI messages studies.

Topics that could possibly be discussed in BoG were noted to be those in sections 6.1-6.4 and 6.6-6.8.

ARCHIVE :
JVET-AF0009-v1.docx
Decisions
noted
The AHG recommended to: Review all related contributions; and Continue SEI messages studies. Topics that could possibly be discussed in BoG were noted to be those in sections 6.1-6.4 and 6.6-6.8.
Citation