JVET-O0004 JVET AHG report: Test material and visual assessment (AHG4) [T. Suzuki, M. Wien, V. Baroncini, R. Chernyak, P. Hanhart, A. Norkin, J. Ye]
The test sequences used for the CfP/CTC are available on ftp://jvet@ftp.ient.rwth-aachen.de in directory “/jvet-cfp” (accredited members of JVET may contact the JVET chairs for login information).
Due to copyright restrictions, the JVET database of test sequences is only available to accredited members of JVET (i.e. members of ISO/IEC MPEG and ITU-T VCEG).
No test sequence selections for the CTC were changed at the last meeting.
On determining a new structure at test sequence repository, there was not much progress since the last meeting. There was discussion in the last meeting that the current directory structure of test sequence ftp site is not good for the current activities. The ftp directory was created during the preparation of CfE/CfP and the same directory structure is still used. One possibility is to re-design the directory as follows, for example,
- ctc/ : Contains the active test set of the common testing conditions
- ahg/ : Contains subdirectories with sequences under consideration. The subfolder might be structured by meeting period (e.g. named by the doc-number of the corresponding meeting report?)
- ce/ : Contains subdirectories for data exchange for specific CE (already implemented, see ce/JVET-{K,L}1031_Deblocking
- upload : stays as before
During the Marrakech meeting, there was a comment that all sequences, all classes should be at the same place. But there is still meaningful to separate SDR, HDR, and 360. Further detail should be discussed in the meeting.
In the discussion, it was suggested to not remove the cfe and cfp directories, but to add the additional ones above (even if there might be some duplication of content or use of symbolic links). This approach was agreed.
The following related contribution was noted.
- JVET-O0451 “AHG4: Subjective comparison of VVC and HEVC”, P. Philippe, J. Fournier (Orange), W. Hamidouche (INSA), JY Aubie (b-com)
The AHG recommended to review related contributions and to continue to collect new test sequences available for JVET with licensing statement.