JVET-W0012 JVET AHG report: Enhanced compression beyond VVC capability (AHG12) [M. Karczewicz, Y. Ye, L. Zhang, B. Bross, X. Li, K. Naser, H. Yang]
The primary activity of the AHG was the “Exploration experiment on enhanced compression beyond VVC capability” (JVET-V2024). The first indication of the achievable improvement over VVC are the results of the EE2 software base (ECM-1.0) as agreed at JVET-V meeting. The combined improvement of the ECM-1.0 over VTM-11.0 with the improved MCTF from JVET-V0056 for AI, RA and LB configurations are:
All Intra Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | -5.78% | -9.67% | -10.61% | 219% | 216% |
Class A2 | -5.47% | -7.85% | -5.90% | 212% | 200% |
Class B | -5.00% | -7.15% | -7.52% | 246% | 213% |
Class C | -6.04% | -7.43% | -7.71% | 247% | 198% |
Class E | -6.20% | -7.84% | -6.72% | 251% | 241% |
Overall | -5.64% | -7.86% | -7.67% | 236% | 212% |
Class D | -4.86% | -5.53% | -5.56% | 251% | 200% |
Class F | -10.03% | -11.63% | -12.07% | 214% | 258% |
Class TGM | -14.61% | -16.09% | -15.97% | 213% | 282% |
Random Access Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | -12.21% | -13.33% | -15.84% | 279% | 453% |
Class A2 | -13.45% | -14.39% | -14.09% | 268% | 546% |
Class B | -11.52% | -12.24% | -11.79% | 271% | 481% |
Class C | -13.26% | -13.23% | -13.39% | 266% | 415% |
Class E | |||||
Overall | -12.51% | -13.15% | -13.49% | 271% | 469% |
Class D | -14.39% | -13.40% | -13.32% | 280% | 449% |
Class F | -12.13% | -13.26% | -13.60% | 253% | 348% |
Class TGM | -12.67% | -14.71% | -14.89% | 245% | 255% |
Low Delay B Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | |||||
Class A2 | |||||
Class B | -9.55% | -9.45% | -9.76% | 237% | 287% |
Class C | -10.99% | -9.24% | -10.94% | 251% | 254% |
Class E | -9.22% | -10.12% | -8.20% | 200% | 241% |
Overall | -9.95% | -9.55% | -9.76% | 231% | 264% |
Class D | -13.37% | -11.54% | -12.00% | 257% | 264% |
Class F | -10.91% | -10.19% | -10.47% | 233% | 232% |
Class TGM | -10.70% | -12.82% | -13.62% | 191% | 186% |
In addition to twelve EE2 contributions, 19 related technical contributions and 2 contributions on the ECM software were received, which were subdivided as follows:
- Partitioning
- JVET-W0110, “AHG12: GPM with inter and intra prediction” [Y. Kidani, H. Kato, K. Kawamura (KDDI)]
- In-Loop Filters
- JVET-W0073, “ALF parameters for RPR” [P. Bordes, F. Galpin, F. Léannec (InterDigital)]
- JVET-W0074, “HLS for ALF parameters for RPR” [P. Bordes, F. Galpin, K. Naser, F. Léannec (InterDigital)]
- JVET-W0079, “AHG12: CTB level filter shape selection of CCALF” [M. G. Sarwer, R. -L. Liao, J. Chen, Y. Ye, X. Li (Alibaba)]
- JVET-W0098, “Non-EE2: Bilateral Inloop Filter on Chroma” [W. Yin, K. Zhang, L. Zhang (Bytedance)]
- JVET-W0101, “AHG11 & AHG12: Deep In-Loop Filter with Adaptive Model Selection and External Attention for Enhanced Compression Beyond VVC Capability” [Y. Li, K. Zhang, L. Zhang (Bytedance)]
- JVET-W0128, “AHG12: Alternative classifiers for ALF” [N. Hu, V. Seregin, M. Karczewicz (Qualcomm)]
- Intra
- JVET-W0067, “EE2-related: Implicit derivation of DIMD blend modes” [X. Li, R.-L. Liao, J. Chen, Y. Ye (Alibaba)]
- JVET-W0069, “[AHG12] On Intra TMP Boundary Conditions” [K. Naser, T. Poirier, F. Le Léannec, G. Martin-Cocher (InterDigital)]
- JVET-W0123, “EE2-related: Fusion for template-based intra mode derivation” [K. Cao, N. Hu, V. Seregin, M. Karczewicz (Qualcomm), Y. Wang, K. Zhang, L. Zhang (Bytedance)]
- JVET-W0124, “EE2-related: Template based intra most probable modes sorting [K. Cao, N. Hu, V. Seregin, M. Karczewicz (Qualcomm)[
- JVET-W0126, “EE2 Related - DIMD with implicitly derived multiple blending modes” [J. Zhao, S. Paluri, S. Kim (LGE)]
- Inter
- JVET-W0068, “EE2-related: A combination of CIIP and DIMD/TIMD” [X. Li, R.-L. Liao, J. Chen, Y. Ye (Alibaba)]
- JVET-W0097, “EE2-related: Combination of EE2-3.3, EE2-3.4 and EE2-3.5” [X. Xiu, C.-W. Kuo, X. Wang (Kwai), R.-L. Liao, Y. Ye, X. Li, J. Chen (Alibaba), Z. Deng, K. Zhang, L. Zhang, N. Zhang, Y. Wang (Bytedance), Y.-J. Chang, H. Huang, V. Seregin, C.-C. Chen, M. Karczewicz (Qualcomm)
- JVET-W0106, “EE2-related: Bilateral matching AMVP-merge mode” [Z. Zhang, H. Huang, C.-C. Chen, V. Seregin, M. Karczewicz (Qualcomm)]
- JVET-W0107, “EE2-related: Adaptive decoder side motion vector refinement” [H. Huang, Z. Zhang, V. Seregin, W.-J. Chien, C.-C. Chen, M. Karczewicz (Qualcomm)]
- JVET-W0112, “AHG12: Diagonal MMVD with ARMC” [Y. Kidani, K. Kawamura (KDDI)]
- JVET-W0122, “EE2-related: On spatial MV propagation and neighboring template block access for template matching and multi-pass DMVR” [C.-C. Chen, C.-T. Hsieh, H. Huang, V. Seregin, W.-J. Chien, Y.-J. Chang, Z. Zhang, Y. Zhang, M. Karczewicz (Qualcomm)]
- Coefficient Coding
- JVET-W0108, “EE2-related: Low complexity sign prediction” [C. Auyeung, X. Li, S. Liu (Tencent)]
- ECM software related
- JVET-W0049, “HG12: on the status of the ECM software” [Y. Ye (Alibaba), M. Karczewicz (Qualcomm), Y.-W. Huang (MediaTek), P. Yin (Dolby), D. Wang (OPPO), X. Wang (Kwai), J. Ström (Ericsson), F. Le Leannec (InterDigital), L. Zhang (Bytedance), S.-H. Kim (LGE), M. Hannuksela (Nokia), P. Wu (ZTE)]
- JVET-W0102, “Preliminary draft of algorithm description for Enhanced Compression Model 1 Software (ECM 1)” [M. Coban (Qualcomm), F. Le Léannec (InterDigital), J. Ström (Ericsson), Y. Ye (Alibaba)]
The AHG recommended:
- To review all the related contributions.
- To encourage contribution of new test sequences, especially 8k resolution, which might be included in future test conditions.
Project development (19)
Deployment and advertisement of standards (2)
Contributions in this area were discussed in session 13 at 0840–0900 UTC on Monday 12 July 2021 (chaired by JRO).