JVET-AM0004 JVET AHG report: Test material and visual assessment (AHG4) [V. Baroncini, T. Suzuki, M. Wien (co-chairs), W. Husak, S. Iwamura, P. de Lagrange, S. Liu, X. Meng, S. Puri, A. Segall, S. Wenger (vice-chairs)]
Testing of video coding technology beyond conditions of exploration experiments
AHG4 has supported the activities of AHG17 on test sequence collection and characterization for the purpose of assessing video coding technology beyond the CTC.
Test sequences
The set of JVET test sequences is hosted at https://vqa.lfb.rwth-aachen.de. A mirror of this site is available at https://datacloud.hhi.fraunhofer.de with the same login credentials. The directory structure of the previous ftp server has been maintained. The test sequences used for CfP/CTC are available in directory “/ctc”.
Due to copyright restrictions, the JVET database of test sequences is only available to accredited members of JVET (i.e., members of ISO/IEC MPEG and ITU-T VCEG). Members of JVET may contact the JVET chair for login information. It is suggested to update the password for the site after each meeting with the Zoom password for that meeting.
Related contributions
(listing documents directly related to AHG4 as well as documents related to testing activities and test material)
JVET AHG report: Test material and visual assessment (AHG4) | V. Baroncini, T. Suzuki, M. Wien (co-chairs), W. Husak, S. Iwamura, P. de Lagrange, S. Liu, X. Meng, S. Puri, A. Segall, S. Wenger (vice-chairs) | |
AHG17: AhG meeting notes | ||
AHG17: Generated VTM anchor bitstreams using LambdaScaleTowardsNextQP | ||
[AHG17] Suggested results reporting template for constrained encoder complexity category | ||
AHG17: Suggestion to enable DMVR encoder control for VTM anchor | ||
AHG15: Analysis of Test Sequences for Game Content in the CfE Document | X. Liang, K. Choi (KHU), C. W. Ryu (Kaon Group) | |
AHG4: proposed updates for VVC multi-layer verification test plan | ||
[AHG17] Overview of the 3GPP codec testing in TR 26.955 | ||
AHG17 ECM/VTM performance under CfE requirement | K. Naser, E. François, F. LeLéannec, F. Galpin, T. Poirier (InterDigital) |
Recommendations
The AHG recommended:
- To progress the work in AHG17 towards finalizing the draft test set for a Joint Call for Evidence on video compression with capability beyond VVC.
- To conduct subjective tests assessing the proposed rate points and coding conditions in the draft CfE.
- To continue to discuss and to update the non-finalized categories of the verification test plan for multilayer VVC and the subjective quality test plan for FGC, including those which have not been addressed yet.
- To collect volunteers to conduct further verification tests and subjective quality tests.
- To collect volunteers to actively contribute to the verification test development.
- To review the set of available test sequences for the verification tests as well as subjective quality tests and potentially collect more test sequences with a variety of content.
- To continue to collect new test sequences available for JVET with licensing statement.
Review of JVET-AM0223 was planned for the second week of the meeting together with AG 5. It was commented that no progress had been made so far in acquiring 10-bit stereoscopic material for multi-view VVC/HEVC testing.