JVET-AM0218 AHG18: Solution beyond scalable coding for ultra-low latency and packet loss resilience [S. Ikonin, V. Khamidullin, I. Gribushin, M. Sychev, X. Ma, E. Alshina (Huawei)]

This contribution describes the coding technology beyond scalable coding that can be used for ultra-low latency and packet loss resilient decoding scenarios. The described technology re-uses concept of data partitioning of H.263/4 which separates prediction and residual information into different sub-streams. Additionally, entropy coding of residual coefficients is performed using multiple independent entropy coded chunks. A lost aware NN-based loop filter is further applied to reduce subjective impact of lost residuals and propagation if these errors via inter frame prediction. A demo video files are provided with contribution.

Compared to and on top of a 2-layer SNR scalability with priority of base layer from JVET-AK0183 (vs. adding high priority DP part of the stream of the proposed approach, and the loss-aware loop filter). Gain is 2.2 dB on average.

About 3% overhead for the multiple chunks.

The loss aware loop filter gets information which parts of the picture are lost. It was trained on VTM streams using BVI-DVC plus error patterns.

Contribution for information – no specific action proposed.

JVET-AN0045 AHG18: Codec software for ultra-low latency and packet loss resilience [S. Ikonin, V. Khamidullin, K. Malyshev, I. Gribushin, X. Ma, E. Alshina (Huawei)]

This contribution includes the software related to document JVET-AM0218 “AHG18: Solution beyond scalable coding for ultra-low latency and packet loss resilience” presented and 39^th JVET meeting in Daejeon, Korea. The video demonstration related to the contribution was also presented during the demo session. The presented ULL coding technology was comprehensively discussed with experts, and many experts expressed the interest about the details. After further polishing and in order to complement AHG18 research activity the software is provided with this contribution. The software is provided as a git patch on top of VTM-based simulation software used in AhG18. It is suggested to include the software into exploration experiments in context of AhG18 work.

It was commented that this investigation does not necessarily need an exploration experiment, could well be done in an AHG study.

It was also commented that more clarification about the needs and use cases of applications would be required. There are other cases than the mobile transmission scenario that is focused here. A larger variety of error conditions matching

It was asked if it is not necessary to investigate with longer sequences, as network losses can be considered as a statistical process. Currently, focus is on simulating problematic cases.

In a possible CfP, it would be relevant that the exact pattern of errors would not be known by the time of...

JVET-AN0018 JVET AHG report: Ultra-low latency and packet loss resilience (AHG18) [S. Ikonin, S. Wenger, V. Zakharchenko (co-chairs), S. Deshpande, S. Fößel, C. Kim, X. Ma, S. Puri, J. Ström (vice-chairs)]

1. Activities

The regular JVET e-mail reflector was used for discussions (jvet@lists.rwth-aachen.de). Few organizational e-mails were sent to reflector.

Teleconference

The teleconference was held on August 21^st with 27 participants attending.

The following topics were discussed:

• JVET-AN0046: On test conditions for ultra-low latency and packet loss resilience with full QP range
  • Network bandwidth point selection automation script
  • LDP/LDB simulations in full QP range
  • Spatial Scalability
• AHG18 software, MRs status
  • MR2: Full VTM
  • MR3: GDR fix
• JVET-AN0045: Codec software for ultra-low latency and packet loss resilience (related to JVET-AM0218)
  • Software overview
  • Transmission priority model

The meeting minutes are available in JVET-AN0049.

Simulation software

Adoption of last JVET meeting (JVET-AM0203, full VTM support) merged to ‘ull-master’ branch: https://vcgit.hhi.fraunhofer.de/jvet-ahg-ull/VVCSoftware_VTM/-/tree/ull-master. JVET-AM0195 (GDR) is cross-check pending.

1. Related contributions

A total of 12 contributions are identified relating to the mandates of AHG18. They are listed below. Some contributions also relate to the work of AHG12.