JVET-AM0016 JVET AHG report: Generative face video compression (AHG16) [Y. Ye (chair), H.-B. Teo, Z. Lyu, S. McCarthy, S. Wang (vice chairs)]

Activities

Regarding the mandate on developing and maintaining the GFVC software, the AHG16 GFVC software tool and accompanying usage instructions and exemplar configurations for experimentation are maintained in the GIT repository at https://vcgit.hhi.fraunhofer.de/jvet-ahg-gfvc. During this AHG period, the updated parameter translators (as in JVET-AL0147) were integrated into the AHG16 software repository. Merge requests to add support for GFV and GFVE SEI messages to HEVC and AVC (as in JVET-AL0148) were submitted to HM and JM software, which are currently pending integration. At this meeting, one contribution on lightweight multi-resolution CFTE model and colour calibration post-processing has been received.

Regarding coordination with AHG9 to develop the GFV and GFVE SEI messages, at this meeting, one contribution related to the chroma key feature in the GFV SEI message has been received.

Related contributions

The following input contribution to this meeting is related to the activities of AHG16:

• JVET-AM0058, AHG16: Lightweight Multi-resolution CFTE Model and Colour Calibration Post-processing Algorithm for Generative Face Video Compression [Z. Zhang, S. Yin, S. Wang (CityUHK), B. Chen, R.-L. Liao, J. Chen, Y. Ye (Alibaba)]

Additionally, the following input contribution is related to the high-level syntax aspects of the generative face video (GFV) and/or generative face video enhancement (GFVE) SEI messages:

• JVET-AM0091, AHG9: On GFV SEI chroma key [J. Boyce, M. M. Hannuksela (Nokia)]

Recommendations

The AHG recommended to:

• Review related contributions;
• Continue AHG16 to study GFVC-related topics.