JVET-AE0063 [AHG9] On operations for multiple NNPFs [L. Chen, O. Chubach, Y.-W. Huang, S. Lei (MediaTek)]

This was discussed in JVET on Friday July 14.

This contribution proposes an SEI message indicating multiple NNPFs as a group/list and related operations for a picture in response to the four questions on item 1)c in JVET-AD0362. The related operations for the indicated multiple NNPFs consist of four types of cascade, alternate, coherence and optional.

(coherence=parallel)

Conceptually this is similar to JVET-AE0052. Parallel is not explicitly in JVET-AE0052. Another aspect is that the encoder can take provision that only a single filter is activated at one time. No specific group activation SEI is needed in JVET-AE0063

Parallel operation might, for example, be useful to generate attention mechanism input for a subsequent network. This is something that would not appear in other SEI messages.

Use cases for parallel operation need more study, including the question how many could be operated in parallel.

Further study required if it is possible to bring those aspects into the SEI processing order SEI message (in VVC), or if this is so specific to NNPF that it would be a burden for implementers who only want to use SEI processing order for simpler cases of SEI messages.

It was agreed to produce an output document “Technology under consideration for future extensions of VSEI”. Proponents of JVET-AE0052 and JVET-AE0063 should combine the aspects from both contributions, and propose a text part.

It was also commented that a software implementation demonstrating different...

JVET-AE0298 AHG9: Combined text of JVET-AE0052 and JVET-AE0063 [M. M. Hannuksela, F. Cricri (Nokia), L. Chen, O. Chubach, Y.-W. Huang, S. Lei (MediaTek)] [late]

This document contains a combination of JVET-AE0052 and JVET-AE0063 for potential inclusion to Technologies under Consideration for VSEI.

The NNPF group design in this section contains the following aspects:

NNPF group characteristics (NNPFGC) SEI message, which can be used to define any of the following:

1. a cascade of NNPFs
2. a group of NNPFs which are activated in an alternating manner so that at most one of these NNPFs is activated by NNPFA SEI messages for any picture unit
3. a set of alternative NNPFs or alternative NNPF groups out of which only one is to be selected in the decoder side
4. a set of NNPFs or NNPF groups intended to be applied in parallel
5. NNPFs or NNPFs groups that are optional

NNPF group activation (NNPFGA) SEI message, which is used for activating an NNPF group.

Extension of the NNPFA SEI message semantics so that it can activate an NNPF group

An update of the general post-processing filtering process using NNPFs to take into account the proposed NNPFGC and NNPFGA SEI messages.

The combined text was presented in JVET Tuesday 18 July 1145.

The text contains a concept where the existing NNPFA SEI can be used to activate a group. It was asked whether a separate group activation SEI message also included in the text is needed at all. This is left for further study.

Decision: Adopt JVET-AE0298 into JVET-AE2032 TuC.

JVET-AE2032 Technologies under consideration for future extensions of VSEI (draft 1) [M. M. Hannuksela, J. Chen, S. Deshpande, S. McCarthy] [WG 5 N 221)] (2023-09-15)

Elements from JVET-AE0061, JVET-AE0298, JVET-AE0064, JVET-AE0079, JVET-AE0095; see detailed notes under these document numbers.

Future meeting plans, expressions of thanks, and closing of the meeting

Future meeting plans were established according to the following guidelines (assuming face-to-face meetings):

• Meeting under ITU-T SG16 auspices when it meets (ordinarily starting meetings on the Tuesday or Wednesday of the first week and closing it on the Wednesday of the second week of the SG16 meeting – a total of 8 meeting days), and
• Otherwise meeting under ISO/IEC JTC 1/‌SC 29 auspices when its MPEG WGs meet (ordinarily starting meetings on the Friday prior to the main week of such meetings and closing it on the same day as other MPEG WGs – a total of 8 meeting days).

In cases where an exceptionally high workload is expected for a meeting, an earlier starting date may be defined. In cases of online meetings, no sessions should be held on weekend days, such that meetings would typically start two days earlier.

Some specific future meeting plans (to be confirmed) were established as follows:

• During Fri. 13 – Fri. 20 October 2023, 32^nd meeting under ISO/IEC JTC 1/‌SC 29 auspices in Hannover, DE,
• During Wed. 17 – Fri. 19 and Mon. 22 – Fri. 26 January 2024, 33^rd meeting under ISO/IEC JTC 1/‌SC 29 auspices, to be held as teleconference meeting,
• During Fri. 19 – Fri. 26 April 2024, 34^thmeeting under ITU-T SG16...