JVET-AF0004 JVET AHG report: Test material and visual assessment (AHG4) [V. Baroncini, T. Suzuki, M. Wien (co-chairs), W. Husak, S. Iwamura, P. de Lagrange, S. Liu, S. Puri, A. Segall, S. Wenger (vice-chairs)]
Verification test preparation for VVC multilayer coding
A teleconference was organized by AG 5 and JVET AhG4 on 2023-09-20 13:00h UTC. The topic was the Verification Test preparation for VVC Multilayer Coding.
The AhG reviewed the status and progress with respect to the compression performance assessment of dual-layer coding category of the verification test. Potential issues with the current configuration and implementation of the VTM software were identified. Furthermore, the suitability of the current test sequences under consideration and the intended rate range were discussed. The provision of alternative test material, potentially including other resolutions, and further study was encouraged. The conduction of corresponding expert viewing tests at the meeting site in Hannover was solicited.
The report of the AhG meeting is available in JVET-AF0044.
Test sequences
The test sequences used for CfP/CTC are available on ftp://jvet@ftp.ient.rwth-aachen.de in directory “/ctc” (accredited members of JVET may contact the JVET chair for login information).
In the report period, test material related to the CTC for SHVC and HEVC SCC has been made available in that directory.
Due to copyright restrictions, the JVET database of test sequences is only available to accredited members of JVET (i.e., members of ISO/IEC MPEG and ITU-T VCEG).
Related contributions
MPEG number | First upload | |||||
2023-10-06 14:09:48 | JVET AHG report: Test material and visual assessment (AHG4) | V. Baroncini, T. Suzuki, M. Wien (co-chairs), W. Husak, S. Iwamura, P. de Lagrange, S. Liu, S. Puri, A. Segall, S. Wenger | ||||
2023-09-20 14:59:44 | 2023-09-20 16:26:38 | 2023-09-20 16:26:38 | AHG4: Report on AhG meeting on verification testing for VVC multilayer coding | |||
2023-09-28 12:30:50 | 2023-10-02 08:11:08 | 2023-10-02 08:11:08 | [AHG4] ECM10.0 evaluation on V3C test content | S. Schwarz, M. M. Hannuksela (Nokia) | ||
2023-10-06 04:56:24 | 2023-10-06 09:00:29 | 2023-10-11 06:44:02 | Evaluation results of Low Complexity Enhancement Video Codec (LCEVC) with HM and VTM on 4K content | O. Chubach, Y.-L. Hsiao, C.-Y. Chen, C.-W. Hsu, T.-D. Chuang, Y.-W. Chen, Y.-W. Huang, S.-M. Lei (MediaTek) | ||
2023-10-06 23:27:22 | 2023-10-06 23:56:26 | 2023-10-06 23:56:26 | AHG4: experiments related to VVC spatial scalability visual testing | |||
2023-10-06 23:28:48 | 2023-10-06 23:33:14 | 2023-10-06 23:33:14 | Compression of Gaming Contents | Z. Lin, K. Cai, J. Sauer, Y. Zhao, E. Alshina (Huawei) | ||
2023-10-11 10:26:29 | 2023-10-11 17:38:45 | 2023-10-11 17:38:45 | [AHG-4] On the proposed gaming sequences from InterDigital and class gaming | S. Puri, T. Poirier, C. Bonnineau, I. Marzuki, R. Utida, E. François (InterDigital) | ||
2023-10-12 01:10:15 | 2023-10-12 01:20:34 | 2023-10-12 01:20:34 | New Film Grain Material based on a Ground Truth approach | D. Ugur, D. Podborski, A. M. Tourapis (Apple Inc) | ||
2023-10-12 01:12:29 | 2023-10-12 01:20:56 | 2023-10-12 01:20:56 | Suggested process for measuring Grain Fidelity using the Ground Truth test set | A. M. Tourapis, J. Kim, S. Paluri, D. Podborski (Apple Inc) |
Recommendations
The AHG recommended:
- To review and consider JVET-AF0186 in the finalization of the multi-layer VVC verification test plan.
- To consider the structure of a verification test report for multi-layer VVC taking into account the results achieved at the Geneva meeting in the content layering category of the verification test plan.
- To review and consider JVET-AE0262 and JVET-AE0263 in the development of the draft plan for subjective quality testing of FGC SEI message.
- To review document JVET-AF0075 in a joint meeting with WG 4 and AG 5.
- To collect volunteers to conduct further verification tests and subjective quality tests, including volunteers to encode.
- To continue to discuss and to update the non-finalized categories of the verification test plan and subjective quality test plan for FGS, including those which have not been addressed yet.
- To review the set of available test sequences for the verification tests as well as subjective quality tests and potentially collect more test sequences with a variety of content.
- To continue to collect new test sequences available for JVET with licensing statement.
A joint meeting with WG 4 and AG 5 was agreed to be held on JVET-AF0075.