JVET-AP0009 JVET AHG report: SEI message studies (AHG9) [J. Boyce, Y.-K. Wang (co-chairs), T. Chujoh, S. Deshpande, M. M. Hannuksela, Y. He, P. de Lagrange, G. J. Sullivan, H. Tan, A. Tourapis, S. Wenger, P. Wu (vice-chairs)]
- Related contributions
As of Monday April 20th, a total of 116 contributions (not including this AHG report) were identified relating to the mandates of AHG9. Some contributions relate to more than one mandate and/or SEI message.
Study the SEI messages in VSEI, VVC, HEVC and AVC (4)
JVET-AP0058, AHG2/AHG9: Some errata items on VVC, VSEI, HEVC, and/or AVC, Y.-K. Wang, J. Xu (Bytedance)
JVET-AP0090, AHG9: On the cancel_flag related semantics in the FP, PRI and CTI SEI messages in VSEI v4, J. Xu, Y.-K. Wang, L. Zhang (Bytedance)
JVET-AP0091, AHG9: On semantics related to persistence_flag and cancel_flag in various SEI messages in VSEI v4 and VSEI TuC, J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0217, AHG9: On FGC SEI message payloadType code points in AVC, R. Skupin, Y. Sanchez, C. Hellge, T. Schierl (HHI)
- Study JVET-AO2032 TuC for VSEI (92)
General (12)
JVET-AP0069, AHG9: On VSEI RBSP, M. M. Hannuksela, J. Boyce, D. Fortin (Nokia)
JVET-AP0076, AHG9: SW for floating point syntax fl(n) and fl(w,t), L. Kerofsky, Y. He, S. Zhao, M. Karczewicz (Qualcomm)
JVET-AP0137, AHG9: On payload sizes for versatile SEI messages, M. Pettersson, M. Damghanian, S. Harribey, R. Sjöberg (Ericsson)
JVET-AP0138, AHG9: On SEI messages presence, M. Damghanian, S. Harribey, M. Pettersson, R. Sjöberg (Ericsson)
JVET-AP0160, AHG9: On signalling of identifiers and numbers of layers for SEI messages in TuC, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0161, AHG9: On presence of SEI messages in multiple layers, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0162, AHG9: On conformance cropping windows for SEI messages in TuC, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0163, AHG9: On inference values of syntax elements in SEI messages in TuC, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0196, AHG9: Working draft for VSEI v5, J. Boyce, M. M. Hannuksela, T. Biatek (Nokia)
JVET-AP0216, AHG9: On SEI extensions for legacy devices, R. Skupin, Y. Sanchez, T. M. Borges, C. Hellge, T. Schierl (HHI)
JVET-AP0229, AHG9: Signalling options for alpha plane metadata in non-auxiliary picture context in AVC, HEVC and VVC, E. Thomas, E. Potetsianakis, E. Alexiou, M.-L. Champel (Xiaomi)
JVET-AP0230, AHG9: Signalling options for depth map metadata in non-auxiliary picture context in AVC, HEVC and VVC, E. Thomas, E. Potetsianakis, E. Alexiou, M.-L. Champel (Xiaomi)
New extensions or constraints of SEI messages specified in VSEI v4 (4)
JVET-AP0083, AHG9: On OMI, S. Zhao, Y. He, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0110, AHG9: On signalling of AI usage type for AURR SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0113, AHG9: On signalling content moderation information in TDI SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0147, AHG9: On the Alpha Channel Information SEI message, C. H. Demarty, E. François, P. de Lagrange, F. Urban, N. Caramelli (InterDigital)
JVET-AP0252, AHG9: On multiple extensions of SEI messages, H. Tan, C. Kim, J. Nam, J. Lee, J. Lim, S. Kim (LGE) [Late]
Scalability dimension information SEI message (3)
JVET-AP0094, AHG9: On the scalability dimension information SEI message in VSEI TuC, J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0098, AHG9: On the SDI confidence map, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0167, AHG9: Fixes to the Scalability Dimension Information SEI message, J. Chen, Y. Ye (Alibaba)
Shutter interval SEI message (2)
JVET-AP0073, AHG9: Proposed Shutter Interval SEI message extension to rolling shutter for version 5 of VSEI, L. Kerofsky, M. Karczewicz (Qualcomm), J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0175, AHG9: On shutter interval information SEI message, X. Xu, M.Tang, S. Liu (Tencent)
Neural-network post-filter characteristics / related URIs (NNPFC / NNPFA) SEI message (8)
JVET-AP0060, AHG9: On nnpfc_uri and nnpfc_tag_uri, S. Deshpande (Sharp)
JVET-AP0068, AHG9: Additional tag URIs for the NNPFC SEI message, M. M. Hannuksela, J. Boyce, F. Cricri (Nokia)
JVET-AP0081, AHG9: On Multiple Inferences for Neural-network Post-filter, S. Deshpande (Sharp)
JVET-AP0092, AHG9: On redundant bits related to string signalling in the CR and NNPFA SEI messages in VSEI TuC, J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0130, AHG3/AHG9: Public source code release of real-time NNPF implementation in VVdeC, J. Funnell, M. Santamaria, R. Yang, F. Cricri, M. M. Hannuksela, S. Schwarz (Nokia)
JVET-AP0171, AHG9: On indication of intermediate data application in EOI, SPO and NNPFC SEI messages, X. Xu, S. Wenger, S. Liu (Tencent) (Also relates to SPO, EOI)
JVET-AP0176, AHG9: Bug fixes of NNPF SEI messages in TuC document, X. Xu, S. Liu (Tencent)
JVET-AP0226, AHG9/AHG18: Missed Picture Generation purpose for NNPF SEI message, S. Ikonin, M. Sychev, K. Malyshev, E. Alshina (Huawei)
SEI processing order (SPO) and processing order nesting (PON) SEI messages (1)
JVET-AP0215, AHG9: On detection of SEI message extensions in SPO, T. M. Borges, Y. Sanchez, R. Skupin, C. Hellge, T. Schierl (HHI)
Encoder optimization information (EOI) SEI message (8)
JVET-AP0067, AHG9: On the encoder optimization information (EOI) SEI message, M. M. Hannuksela, J. Boyce (Nokia)
JVET-AP0111, AHG9: On spatial quality optimization in EOI SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0150, AHG9: Suggested Modifications for EOI SEI Message, Y. Gao, P. Wu, S. Xie, Y. Bai (ZTE)
JVET-AP0152, AHG9: Extension of Temporal Extrapolation Support for EOI SEI Message, Y. Gao, P. Wu, S. Xie, Y. Bai (ZTE)
JVET-AP0165, AHG9: On temporal resampling information in EOI SEI message, J. Chen, Y. Ye (Alibaba)
JVET-AP0166, AHG9: On depth information extension in EOI SEI message, J. Chen, Y. Ye (Alibaba)
JVET-AP0172, AHG9: On temporal sublayer limitation in EOI SEI message, X. Xu, S. Liu (Tencent)
JVET-AP0173, AHG9: On temporal extrapolation semantics in EOI SEI message, X. Xu, S. Liu (Tencent)
Modality information SEI message (2)
JVET-AP0095, AHG9: On the modality information SEI message extension, J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0121, AHG9: On MI SEI Extension to Indicate Sample Value Usage, S. Zhao, Y. He, L. Kerofsky, M. Karczewicz (Qualcomm)
Digitally signed content (DSC) SEI messages (5)
JVET-AP0136, AHG9: Fixes to subpicture signing for digitally signed content SEI messages, M. Pettersson, R. Sjöberg, M. Damghanian, S. Harribey (Ericsson)
JVET-AP0142, AHG9: On subpicture-based DSC SEI messages and subpicture extraction, H. Tan, J. Lee, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0164, AHG9: Miscellaneous aspects of digitally signed content SEI messages in TuC, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0188, AHG9: TuC DSC subpicture improvements, I. Sodagar (Dolby)
JVET-AP0231, AHG9: On DSC SEI support for subpictures, J. Boyce, M. M. Hannuksela (Nokia)
Packed regions information (PRI) SEI message (1)
JVET-AP0102, AHG9: On the PRI SEI message, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
Film grain regions characteristics (FGRC) SEI message (5)
JVET-AP0055, AHG9: Editorial changes for the FGRC SEI message, Y.-K. Wang, J. Xu (Bytedance)
JVET-AP0056, AHG9: Bug fixes for the FGRC SEI message, Y.-K. Wang, J. Xu, K. Zhang (Bytedance)
JVET-AP0057, AHG9: Some potential improvements for the FGRC SEI message, Y.-K. Wang, J. Xu (Bytedance)
JVET-AP0061, AHG9/AHG13: On Film Grain Regions Characteristics SEI message, S. Deshpande, J. Samuelsson-Allendes (Sharp)
JVET-AP0062, AHG9: On the FGRC SEI message, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
Constituent rectangles SEI message (3)
JVET-AP0092, AHG9: On redundant bits related to string signalling in the CR and NNPFA SEI messages in VSEI TuC, J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0099, AHG9: On the CR SEI message, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0159, AHG9: Miscellaneous aspects of constituent rectangles and enhanced colour format information SEI messages, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
Quality metrics (QM) SEI message (5)
JVET-AP0088, AHG9: On the QM SEI message, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0135, AHG9: On circular reference in the QM SEI message, C. H. Demarty, A. Ak, R. James (InterDigital)
JVET-AP0139, AHG9: On the QM SEI message, C. H. Demarty, A. Ak, R. James (InterDigital)
JVET-AP0154, AHG9: On the quality metrics SEI message, Y. Gao, P. Wu, S. Xie, S. Wang, Y. Bai (ZTE)
JVET-AP0174, AHG9: On quality metrics SEI message, X. Xu, S. Wenger, S. Liu (Tencent)
Lens optical correction SEI message (1)
JVET-AP0075, AHG9: Proposed Lens Optical Correction SEI message for version 5 of VSEI, L. Kerofsky, Y. He, S. Zhao, M. Karczewicz (Qualcomm), G. Teniou, S. Wenger (Tencent)
Display overlays information (DOI) SEI message (6)
JVET-AP0103, AHG9: On the DOI SEI message, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0104, AHG9: On the DOI alpha component, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0114, AHG9: On miscellaneous aspects of DOI SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0115, AHG9: On viewer advisory overlay in the DOI SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0131, AHG9: On display overlays information SEI message, K. Abe, T. Nishi (Panasonic)
JVET-AP0158, AHG9: On signalling of target picture in display overlays information SEI message, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
Enhanced colour format information (ECFI) SEI message (3)
JVET-AP0106, AHG9: On signalling packed channels in ECFI SEI message, H. Tan, C. Kim, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0116, AHG9: On single-layer and chroma format support in the ECFI SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0159, AHG9: Miscellaneous aspects of constituent rectangles and enhanced colour format information SEI messages, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
Photosensitive content information (PCI) SEI message (1)
JVET-AP0129, AHG9: On PCI SEI, T. Biatek, S. He, J. Boyce, M. M. Hannuksela (Nokia)
Display rectangles (DR) SEI message (3)
JVET-AP0119, AHG9: On display rectangles SEI message, J. Nam, H. Tan, J. Lee, C. Kim, J. Lim, S. Kim (LGE)
JVET-AP0126, AHG9: On DR SEI, T. Biatek, J. Boyce, M. M. Hannuksela (Nokia)
JVET-AP0155, AHG9: On the display rectangles SEI message, S. Xie, P. Wu, Y. Gao, W. Niu, Y. Bai (ZTE)
Picture segmentation information (PSI) SEI message (1)
JVET-AP0089, AHG9: On the PSI SEI message, Y. He, S. Zhao, L. Kerofsky, M. Karczewicz (Qualcomm)
Danmu information (DI) SEI message (6)
JVET-AP0097, AHG9: Implementation and showcase for the danmu information SEI message, J. Xu (Bytedance)
JVET-AP0117, AHG9: On danmu information SEI messages, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0127, AHG9: On Danmu SEI, T. Biatek, S. He, J. Boyce, M. M. Hannuksela (Nokia)
JVET-AP0132, AHG9: On Danmu Information SEI, S. He, T. Biatek, J. Boyce, M. M. Hannuksela (Nokia)
JVET-AP0151, AHG9: On the default parameters in the DI SEI message, S. Xie, P. Wu, Y. Gao, W. Niu, Y. Bai (ZTE)
JVET-AP0153, AHG9: Enable the use of segmentation planes with the DI SEI message, S. Xie, P. Wu, Y. Gao, W. Niu, Y. Bai (ZTE)
Colour mapping information (CMI) SEI message (4)
JVET-AP0071, AHG9: On the colour mapping information SEI message, J. Samuelsson-Allendes, S. Deshpande (Sharp)
JVET-AP0096, AHG9: On the colour mapping information SEI message, J. Xu, Y.-K. Wang, K. Zhang (Bytedance)
JVET-AP0122, AHG9: On CMI, S. Zhao, Y. He, L. Kerofsky, M. Karczewicz (Qualcomm)
JVET-AP0128, AHG9: On CMI SEI, T. Biatek, J. Boyce, M. M. Hannuksela (Nokia)
Auxiliary sampling information SEI message (1)
JVET-AP0148, AHG9:On Auxiliary sampling alignment information SEI, S. Wang, Y. Gao, P. Wu, S. Xie, Y. Bai (ZTE)
Localization and mapping (LAM) SEI message (5)
JVET-AP0074, AHG9: Proposed Localization and Mapping SEI message for version 5 of VSEI, L. Kerofsky, Y. He, S. Zhao, M. Karczewicz (Qualcomm), G. Teniou, S. Wenger (Tencent)
JVET-AP0093, AHG9: On group cancellation for the localization and mapping SEI message, J. Xu, Y.-K. Wang (Bytedance)
JVET-AP0112, AHG9: On miscellaneous aspects of LAM SEI message, C. Kim, H. Tan, J. Lee, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0157, AHG9: On localization and mapping SEI message with multiple cameras, J. Lee, H. Tan, C. Kim, J. Nam, J. Lim, S. Kim (LGE)
JVET-AP0204, AHG9: Rotation precision in LAM SEI message, Y. Sanchez, R. Skupin, P. Helle, T. Hinz, J. Pfaff, H. Schwarz, D. Marpe, T. Wiegand (Fraunhofer HHI)
Sample interleaving SEI message (3)
JVET-AP0077, AHG9: On Sample Interleaving, L. Kerofsky, Y. He, S. Zhao, M. Karczewicz (Qualcomm)
JVET-AP0134, AHG9: On the Sample Interleaving SEI message, C. H. Demarty, A. Ak, R. James (InterDigital)
JVET-AP0193, AHG9: Syntax for the sample interleaving SEI message, J. Boyce, S. He, T. Biatek, M. M. Hannuksela (Nokia)
JVET-AP0097, AHG9: Implementation and showcase for the danmu information SEI message, J. Xu (Bytedance)
Also in 2.2.20
JVET-AP0130, AHG3/AHG9: Public source code release of real-time NNPF implementation in VVdeC, J. Funnell, M. Santamaria, R. Yang, F. Cricri, M. M. Hannuksela, S. Schwarz (Nokia)
Also in 2.2.5
JVET-AP0146, AHG9: Software implementation of the Green SEI message and demonstration of the use of attenuation map information metadata for display adaptation, C. H. Demarty, N. Caramelli, F. Aumont (InterDigital)
JVET-AP0078, AHG9: Support of Infrared Auxiliary Picture (AUX_IR) and IR Information SEI for Sample Interpretation, S. Zhao, L. Kerofsky, Y. He, M. Karczewicz (Qualcomm)
JVET-AP0084, AHG9: Support of Gain Map Auxiliary Picture Type and Gain Map SEI Message, S. Zhao, L. Kerofsky, Y. He, M. Karczewicz (Qualcomm)
JVET-AP0085, AHG9: Subject Recognition Information(SRI) SEI message, Q. Zhang (BOE)
JVET-AP0177, AHG9: Transcoding history information SEI message, X. Xu, S. Wenger, S. Liu (Tencent), Johan Pardo, Alexander Karabutov, Hongjie You, Atanas Boev, Johannes Sauer, Timofey Solovyev, Elena Alshina (Huawei)
JVET-AP0179, AHG9: Historical Information SEI message, J. Pardo, A. Karabutov, H. You, A. Boev, J. Sauer, T. Solovyev, E. Alshina (Huawei), X. Xu, S. Liu (Tencent)
JVET-AP0197, AHG9: Shot summarization information SEI message, J. Boyce, M. M. Hannuksela (Nokia)
Coordinate with the joint AHG on Gaussian splat coding about aspects related to the usage of SEI messages (13)
JVET-AP0079, AHG9: Triplane video-based implicit Gaussian splatting with a scaffold-based anchor point framework, B. Kathariya, D. Y. Lee, T. Huang, F. Pu, G. Su, P. Yin, G. J. Sullivan, S. Oh, W. Husak (Dolby)
JVET-AP0100, AHG9: Gaussian splatting information SEI message, Y. He, J. Jung, L. Kerofsky, G. van der Auwera, M. Karczewicz (Qualcomm), J. Ricard, G. Teniou, S. Wenger (Tencent), J. Xu, Y.-K. Wang, L. Zhang (Bytedance)
JVET-AP0101, AHG9: GSI SEI message workflow and packing examples, Y. He, J. Jung, L. Kerofsky, G. van der Auwera, M. Karczewicz (Qualcomm), J. Ricard, G. Teniou, S. Wenger (Tencent), J. Xu, Y.-K. Wang, L. Zhang (Bytedance)
JVET-AP0108, AHG9: On Gaussian Splatting Information SEI message, J. Do, H. Lee, G. Bang (ETRI)
JVET-AP0109, AHG9: Enhancements to the Gaussian Splatting Information SEI message, H. Lee, J. Kang, J. Do, G. Bang (ETRI)
JVET-AP0194, AHG9: Common picture format for Gaussian splats coding, J. Boyce, M. M. Hannuksela (Nokia)
JVET-AP0195, AHG9: Splatting information SEI with patches, J. Boyce, M. M. Hannuksela (Nokia)
JVET-AP0205, AHG9: On the GSI SEI message for spatial random access, Y. He, J. Jung, L. Kerofsky, G. van der Auwera, M. Karczewicz (Qualcomm), J. Ricard, G. Teniou, S. Wenger (Tencent)
JVET-AP0213, AHG9: On implicit representations with the Gaussian splatting information SEI message, S. Lee, S. Sasse, Y. Berendsohn, Y. Sanchez, R. Skupin, T. M. Borges, C. Hellge, T. Schierl (HHI)
JVET-AP0220, AHG9: Showcase for Real-time Decoding using Video-based Implicit Representations for 4DGS, S. Lee, S. Sasse, Y. Berendsohn, Y. Sanchez, R. Skupin, C. Hellge, T. Schierl (HHI)
JVET-AP0223, AHG9: Software implementation and results of the GSI SEI message with HM, HM-SCM, and VTM, J. Ricard, G. Teniou, S. Wenger (Tencent)
JVET-AP0225, AHG9: Extended gaussian splatting information SEI message with SH non-uniform quantization and 2D transforms, J. Ricard, G. Teniou, S. Wenger (Tencent)
JVET-AP0227, AHG9: Content-adaptive packing order optimization for 3D Gaussian splatting video coding, J. Ricard, G. Teniou, S. Wenger (Tencent)
- Activities
The regular JVET e-mail reflector was used for discussions (jvet@lists.rwth-aachen.de) with [AHG9] in message headers. No emails with [AHG9] were exchanged.
Git projects were set up for reporting and tracking of specification bugs for VSEI and the TuC, at the links below. It is encourage to submit an issue to report any specification bugs.
- VSEI: https://vcgit.hhi.fraunhofer.de/jvet/publications/VSEI
- TuC: https://vcgit.hhi.fraunhofer.de/jvet/publications/VSEI-TuC
- Recommendations
The AHG recommended to:
- Review all related contributions
- Continue SEI messages studies
It was requested to identify which contributions of Gaussian splatting have/have-not duplicate submissions to the JAhG.