JVET-AG0005 JVET AHG report: Conformance testing (AHG5) [I. Moccagatta (chair), F. Bossen, K. Kawamura, P. de Lagrange, T. Ikai, S. Iwamura, H.-J. Jhu, S. Paluri, K. Sühring, Y. Yu (vice chairs)]

Activities

The AHG communication is conducted through the main JVET reflector, jvet@lists.rwth-aachen.de, with [AHG5] in message headers. However, no correspondence marked as AHG5 was sent between the 32^nd and 33^rd meetings.

Timeline

The progress on the VVC conformance testing specification is proceeding per the timeline below:

• VVCv1 conformance:
  • ISO/IEC FDIS 23090-15 issued from 2021-10 meeting, FDIS registered for formal approval 2022-07-11, FDIS ballot closed 2022-11-04, standard published 2022-11-24
  • H.266.1 V1 Consent 2022-01-28, Last Call began 2022-04-01, Approved 2022-04-29, pre-published 2022-05-17, standard published 2022-07-12.
• VVCv2 conformance:
  • ISO/IEC 23090-15/Amd.1 CDAM: 2021-10
  • ISO/IEC 23090-15/Amd.1 DAM: 2022-01
  • DAM ballot closed 2022-11-15
  • ISO/IEC FDIS 23090-15:202x 2nd edition text output of 2023-01, preparation delayed to 2023-09
  • H.266.1 V2 forwarded by JVET and Q6/16 for ITU-T Consent: 2023-07
  • H.266.1 V2 approved 2023-09-13
  • H.266.2 V2 pre-published 2023-10-06
  • H.266.2 V2 published 2023-10-19

Status on bitstream submissions

The status at the time of preparation of this report is as follows:

• Conformance bitstreams for VVC v1:
  • 104 bitstream categories have been identified
  • At least one bitstream has been submitted in each identified category
  • 283 total bitstreams have been provided, checked, and made available
  • No changes in bitstreams between 32^nd and 33^rd meetings
• Conformance bitstreams for VVC operation range extensions:
  • 57 bitstream categories have been identified
  • 1 bitstream of 1 identified category has been re-generated
  • 128 bitstreams of 57 identified categories have been cross-checked and uploaded.
  • No changes between 32^nd and 33^rd meeting.

Activities and Discussion

The AHG activities were on schedule with the preliminary timeline shown above.

VVC activities:

No change in bitstreams and/or packages, 2^nd edition packages are available at https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVC2ndEd/

VVC operation range extensions activities:

No change in bitstreams and/or packages, 2^nd edition packages are available at https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVC2ndEd/

VVC Multilayer activities:

The 7 additional conformance bitstreams for VVC multilayer configurations in JVET-AE2028 are decoded correctly using VTM-23.0 and are available in https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVCMultilayer/under_test/VTM-23.0/.

Volunteers to cross check these 7 conformance bitstreams for VVC multilayer configurations have been identified and cross-check is ongoing.

HEVC Multiview supporting extended bit depth activities:

A merge request (MR) implementing the HEVC Multiview Main 10 profiles in JVET-AA1011 has been submitted in https://vcgit.hhi.fraunhofer.de/jvet/HTM/-/merge_requests/5

An implementation for the other HEVC Multiview profiles in JVET-AA1011 (Multiview Monochrome, and Multiview Monochrome 10 profiles) is still in progress.

Cross-checking of the 4 HEVC Multiview supporting extended bit depth (Multiview Main 10) bitstreams provided in AD0232 and AE0295 is contingent to the merging of the above MR. Review of the MR is on-going.

The regular JVET e-mail reflector was used for discussions (jvet@lists.rwth-aachen.de).

The AHG5 chairs and JVET chairs can be reached at jvet-conformance@lists.rwth-aachen.de. Participants should not subscribe to this list but may send emails to it.

Relevant contributions

JVET-AG0201 – On MV-HEVC Profiles [Y.-K. Wang, H. Liu, L. Zhang, S. Jiao, C. Hu, J. Cui, G. Xu , A. M. Tourapis, D. Podborski, S. Paluri].

Ftp site information

The procedure to exchange the bitstream (ftp cite, bitstream files, etc.) is specified in Sec 2 “Procedure” of JVET-R2008. The ftp and http sites for downloading bitstreams are

• VVC:

ftp://ftp3.itu.int/jvet-site/bitstream_exchange/VVC

https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVC/

• VVC operation range extensions:

ftp://ftp3.itu.int/jvet-site/bitstream_exchange/VVCv2

https://www.itu.int/wftp3/av-arch/jvet-site/bitstream_exchange/VVCv2

The ftp site for uploading bitstream file is as follows.

ftp://ftp3.itu.int/jvet-site/dropbox/

(user id: avguest, passwd: Avguest201007)

If using FileZilla, the following configuration is suggested:

In the Filezilla Edit 🡪 Settings 🡪 Connection menu, it may also be necessary to set the minimum TLS level to 1.0.

Recommendations

The AHG recommended the following:

• Proceed with the cross-checking of the additional conformance bitstreams for VVC multilayer configurations (JVET-AE2028).
• Maintain and update the conformance bitstream database and contribute to report problems in JVET document 1004.
• Continue the generation, cross-checking, and documentation of the conformance streams for the HEVC multiview profiles supporting extended bit depth (JVET-AA1011).

It is noted that availability of software (HTM) and verified conformance streams for the new HEVC Multiview profiles by the next meeting would be important to progress those profiles into the standard.