JVET-AL0004 JVET AHG report: Test material and visual assessment (AHG4) [V. Baroncini, T. Suzuki, M. Wien (co-chairs), W. Husak, S. Iwamura, P. de Lagrange, S. Liu, X. Meng, S. Puri, A. Segall, S. Wenger (vice-chairs)]
Activities
Testing of video coding technology beyond conditions of exploration experiments
AHG4 has supported the activities of AHG17 on test sequence collection and characterization for the purpose of assessing video coding technology beyond the CTC.
Test sequences
The server providing JVET test sequences has been updated. The new site is https://vqa.lfb.rwth-aachen.de. A mirror of this site is available at https://datacloud.hhi.fraunhofer.de with the same login credentials. The directory structure of the previous ftp server has been maintained. The test sequences used for CfP/CTC are available in directory “/ctc”.
Due to copyright restrictions, the JVET database of test sequences is only available to accredited members of JVET (i.e., members of ISO/IEC MPEG and ITU-T VCEG). Members of JVET may contact the JVET chair for login information. It is suggested to update the password for the site after each meeting with the Zoom password of that meeting.
Related contributions
AHG4/AHG17: Additional cropped HDR sequences for non-CTC testing | A. Filippov, J. Konieczny, Z. Zhi, V. Rufitskiy, H. Qin, T. Dong, X. Tang (TCL), S. Shen, Y. Qin, Y. Wang, X. Wang, Y. Guan (NERC-DTV) |
Recommendations
The AHG recommended:
- To progress the work in AHG17 towards setting up a test set suitable for performance assessment of video compression technology beyond the JVET CTC.
- To consider the input contribution related to AHG4/AHG17 in the development of the draft text for a potential CfE.
- To continue to discuss and to update the non-finalized categories of the verification test plan for multilayer VVC and the subjective quality test plan for FGC, including those which have not been addressed yet.
- To collect volunteers to conduct further verification tests and subjective quality tests.
- To collect volunteers to actively contribute to the verification test development.
- To review the set of available test sequences for the verification tests as well as subjective quality tests and potentially collect more test sequences with a variety of content.
- To continue to collect new test sequences available for JVET with licensing statement.
Multi-layer to be further discussed in context of JVET-AL0289.
For potential multi-view tests, 10 bit stereo material would be needed.
It was suggested to make updates to various CTC documents regarding the location on content only in cases when they are changed on other issues. Mentioning the location in JVET-AL1012 should be sufficient, or refer to that document in CTC documents.