JVET-AD0005 JVET AHG report: Conformance testing (AHG5) [D. Rusanovskyy, I. Moccagatta (co-chairs), F. Bossen, K. Kawamura, T. Ikai, H.-J. Jhu, K. Sühring, Y. Yu (vice-chairs)]

Activities

The AHG communication is conducted through the main JVET reflector, jvet@lists.rwth-aachen.de, with [AHG5] in message headers. However, no correspondence marked as AHG5 was sent between the 29^th and 30^th meetings.

Timeline

The progress on the Conformance testing specification was proceeding per the timeline below:

• VVCv1 conformance:
  • ISO/IEC FDIS 23090-15 issued from 2021-10 meeting, FDIS registered for formal approval 2022-07-11, FDIS ballot closed 2022-11-04, standard published 2022-11-24
  • H.266.1 V1 Consent 2022-01-28, Last Call began 2022-04-01, Approved 2022-04-29, pre-published 2022-05-17, standard published 2022-07-12.
• VVCv2 conformance:
  • ISO/IEC 23090-15/Amd.1 CDAM: 2021-10
  • ISO/IEC 23090-15/Amd.1 DAM: 2022-01
  • DAM ballot closed 2022-11-15, ready to proceed to FDAM at current meeting 2023-01
  • H.266.1 V2 Consent planned for 2023-07

Status on bitstream submission

There were no changes to the submitted bitstreams. The status at the time of preparation of this report was as follows:

• Conformance bitstreams for VVC:
  • 104 bitstream categories have been identified
  • At least one bitstream has been submitted in each identified category
  • 283 total bitstreams have been provided, checked, and made available
  • As reported in JVET-AB0005, HRD_A_Fujitsu (HRD_A_Fujitsu_4) has been regenerated to avoid CPB underflow
  • 7 of the 10 bitstreams reported in Ticket #1581 have been re-generated
• Conformance bitstreams for VVC operation range extensions:
  • 57 bitstream categories have been identified
  • 1 bitstream of 1 identified category has been re-generated
  • 128 bitstreams of 57 identified categories have been cross-checked and uploaded.
  • No changes between 29^th and 30^th meeting.

Activities and Discussion

The AHG activities were on schedule with the preliminary timeline shown above.

VVC activities:

Seven of the 10 bitstreams reported in Ticket #1581 have been re-generated:

• ILRPL_A_Huawei (ILRPL_A_Huawei_3)
• OPI_B_Nokia (OPI_B_Nokia_4)
• SPATSCAL444_A_Qualcomm (SPATSCAL444_A_Qualcomm_3)
• SPATSCAL_A_Qualcomm (SPATSCAL_A_Qualcomm_4)
• VPS_A_INTEL (VPS_A_INTEL_4)
• VPS_B_ERICSSON (VPS_B_ERICSSON_2)
• VPS_C_ERICSSON (VPS_C_ERICSSON_3)

and are available in the dropbox.

The remaining 3 bitstreams, as follows:

• OLS_A_Tencent_5
• OLS_B_Tencent_5
• OLS_C_Tencent_5

have been re-generated with unmodified VTM-20.0 encoder, but VTM-20.0 decoder cannot decode them correctly. Ticket #1595 has been filed to report this problem. The problem may be related to #1581.

The 7 re-generated bitstreams, HRD_A_Fujitsu_4, and the remaining conformance streams are decoded correctly using VTM-20.0 w/o range extension support.

VVC operation range extensions activities:

All bitstreams are decoded correctly using VTM-20.0.

The regular JVET e-mail reflector was used for discussions (jvet@lists.rwth-aachen.de).

The AHG5 chairs and JVET chairs can be reached at jvet-conformance@lists.rwth-aachen.de. Participants should not subscribe to this list but may send emails to it.

Contributions

JVET-AD0101 - Additional conformance tests of scaling window functionality for multilayer coding [Shunsuke Iwamura, Shimpei Nemoto, Atsuro Ichigaya].

JVET-AD0232 - HEVC Multiview Profiles: Implementation Status [Seethal Paluri, Dimitri Podborski, Alexis Tourapis].

Ftp site information

The procedure to exchange the bitstream (ftp cite, bitstream files, etc.) is specified in Sec 2 “Procedure” of JVET-R2008. The ftp and http sites for downloading bitstreams are

• VVC:

ftp://ftp3.itu.int/jvet-site/bitstream_exchange/VVC

https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVC/

• VVC operation range extensions:

ftp://ftp3.itu.int/jvet-site/bitstream_exchange/VVCv2

https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVCv2

The ftp site for uploading bitstream files is as follows.

ftp://ftp3.itu.int/jvet-site/dropbox/

(user id: avguest, passwd: Avguest201007)

If using FileZilla, the following configuration is suggested:

In the Filezilla Edit 🡪 Settings 🡪 Connection menu, it may also be necessary to set the minimum TLS level to 1.0.

Recommendations

The AHG recommended the following:

• Proceed with the generation, cross-checking, and documentation of the additional conformance bitstreams for VVC, in particular conformance bitstreams for VVC multilayer configurations (JVET-AC2028).
• Maintain and update the conformance bitstream database and contribute to report problems in JVET document JVET-AC1004.
• Start the generation, cross-checking, and documentation of the conformance streams for the HEVC multiview profiles supporting extended bit depth (JVET-AA1011).