JVET-AL0176 AHG18: Proposed methodology and test conditions for ultra-low latency and error resilience performance evaluation [S. Ikonin, X. Ma, I. Gribushin, M. Sychev, E. Alshina (Huawei)]

In 37^th JVET an AHG18 on ultra-low latency and packet loss resilience was established. This contribution proposes evaluation methodology and test conditions suggested to be used for performance assessment in context of the AHG18 work. The document proposes objective quality metrics to be evaluated, and corresponding excel template for quality plots construction and summary collecting.

It was suggested to conduct visual comparison in the next meeting, e.g. comparing PSNR of frozen frames and corrupted reference against the subjective quality.

It was suggested that other concealment methods used during AVC and SHVC (MANE) development might also be considered in the future. Also test conditions used by that time should be studied.