JVET-T0004 JVET AHG report: Test material and visual assessment (AHG4) [V. Baroncini, T. Suzuki, M. Wien, A. Norkin, A. Segall, Y. Ye]
This report summarizes the activities of the AhG4 on Test material and visual assessment that has taken place between the 18th and 19th JVET meetings. Two online AHG meetings were held related to the preparation of the VVC verification tests in the SDR HD and 360° video categories. The inputs to these AHG meetings and the AHG meeting reports are provided in the input documents JVET-T0043, JVET-T0044, JVET-T0045, JVET-T0046, respectively. The results of the visual tests in the SDR UHD category of the VVC verification tests are reported in input document JVET-T0097.
Verification test
For the SDR UHD Random Access category, formal visual tests have been conducted at GBTech, Rome, IT, and RWTH Aachen University, Aachen, DE. The testing procedure was adapted to the restrictions due to the COVID-19 pandemic and therefore took more time than initially planned. The results are provided in input contribution JVET-T0097.
An AHG meeting for SDR HD was held on 2020-09-03, reviewing the outcome of a dedicated experts viewing session as reported in JVET-T0043. The AHG meeting report is provided in JVET-T0045. As a major outcome of this meeting, it was suggested to include both, SDR HD Random Access (RA) and SDR HD Low Delay (LD) configurations in the next update of the Verification Test Plan. The identification and collection of SDR HD test sequences for both categories is in progress.
An AHG meeting for 360° video was held on 2020-09-04, reviewing the outcome of an experts viewing session for rate point selection as reported in JVET-T0044. The AHG meeting report is provided in JVET-T0046. Potential improvements to the 360Lib software were identified for the projection formats GCMP and PCMP.
For the HDR category, the Zoom sessions were held between the verification test coordinators and A. Segall on display calibration and process planning. The identified display settings are collected in JVET-T0106. Due to the general delays for the pandemic, the effort of rate point selection has not been completed by the beginning of this meeting.
Test sequences
The test sequences used for CfP/CTC are available on ftp://jvet@ftp.ient.rwth-aachen.de in directory “/jvet-cfp” (accredited members of JVET may contact the JVET chairs for login information).
Due to copyright restrictions, the JVET database of test sequences is only available to accredited members of JVET (i.e. members of ISO/IEC MPEG and ITU-T VCEG).
Related contributions
The following related contributions were submitted.
- JVET-T0043 “Status Report on SDR HD Low Delay Verification Test Preparation” [M. Wien (RWTH), V. Baroncini (VABTech ltd)]
- JVET-T0044 “Status Report on 360 Video Verification Test Preparation” [M. Wien (RWTH), V. Baroncini (VABTech), T. Suzuki (Sony)]
- JVET-T0045 “AHG4: Agenda and report of the AHG meeting on the SDR HD Verification Tests on 2020-09-03” [M. Wien (RWTH), V. Baroncini (VABTech ltd)]
- JVET-T0046 “AHG4: Agenda and report of the AHG meeting on the 360 Video Verification Tests on 2020-09-04” [M. Wien (RWTH), V. Baroncini (VABTech ltd), Y. Ye (Alibaba)]
- JVET-T0060 “AHG4: new video conference sequences for HD verification testing” [S. Xu, R.-L. Liao, J. Chen, Y. Ye (Alibaba)]
- JVET-T0082 “New HLG sequences for high bit-depth video coding” [K. Kondo, M. Ikeda, A. Browne (Sony)]
- JVET-T0097 “Report on VVC compression performance verification testing in the SDR UHD Random Access Category” [M. Wien (RWTH), V. Baroncini (VABTech)]
- JVET-T0103 “Information on and analysis of the VVC encoders in the SDR UHD verification test” [C. Helmrich, B. Bross, J. Pfaff, H. Schwarz, D. Marpe, T. Wiegand (HHI)]
- JVET-T0106 “AHG4/AHG7: Report on Display Settings for HDR/WCG Verification Tests” [A. Segall, M. Wien, V. Baroncini]
It was agreed that these contributions should be reviewed.
The AHG recommended:
- To review the input contributions related to the verification test preparation at an early stage of the meeting.
- To continue to discuss and to update the non-finalized categories of the verification test plan
- To create a BoG to progress the update of the verification test plan.
- To collect volunteers to conduct the verification test, including volunteers to encode.
- To review the set of available test sequences for the verification tests and potentially collect more test sequences with a variety of content.
- To continue to collect new test sequences available for JVET (with licensing statements).