JVET-AJ0012 JVET AHG report: Enhanced compression beyond VVC capability (AHG12) [M. Karczewicz, Y. Ye, L. Zhang (co-chairs), B. Bross, R. Chernyak, X. Li, K. Naser, Y. Yu (vice-chairs)]
- Activities
The Common Test Conditions were updated (JVET-AI2017). A new classF_lowdelay configuration file was added, which will be used in low-delay coding of screen content sequences (classes F and TGM). The primary activity of the AHG was the “Exploration experiment on enhanced compression beyond VVC capability” (JVET-AI2024). The combined improvements of the ECM-14.0 over VTM-11.0ecm14.0 anchor for AI, RA and LB configurations are:
All Intra Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | -13.22% | -14.28% | -25.56% | 1027.4% | 499.0% |
Class A2 | -20.23% | -22.93% | -27.49% | 1017.1% | 516.3% |
Class B | -13.68% | -21.41% | -19.24% | 946.6% | 526.5% |
Class C | -13.74% | -10.65% | -11.72% | 936.0% | 466.6% |
Class E | -17.61% | -20.82% | -19.15% | 907.0% | 530.6% |
Overall | -15.36% | -17.98% | -19.98% | 961.9% | 507.0% |
Class D | -11.59% | -7.67% | -8.17% | 924.6% | 483.1% |
Class F | -29.28% | -32.84% | -33.09% | 606.3% | 558.8% |
Class TGM | -42.24% | -47.92% | -47.17% | 508.4% | 604.3% |
Random Access Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | -26.35% | -22.60% | -34.85% | 1050.1% | 994.0% |
Class A2 | -29.45% | -32.76% | -38.16% | 992.2% | 1183.8% |
Class B | -23.85% | -30.85% | -28.16% | 849.2% | 1008.1% |
Class C | -25.61% | -21.03% | -21.95% | 876.9% | 1068.8% |
Class E | |||||
Overall | -25.94% | -26.96% | -29.84% | 921.9% | 1054.4% |
Class D | -26.48% | -21.78% | -22.78% | 844.5% | 1165.9% |
Class F | -32.10% | -34.18% | -35.05% | 712.1% | 677.3% |
Class TGM | -41.56% | -47.16% | -46.90% | 661.3% | 604.4% |
Low Delay B Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | |||||
Class A2 | |||||
Class B | -18.82% | -44.06% | -41.03% | 753.6% | 812.9% |
Class C | -21.38% | -33.77% | -34.25% | 686.8% | 858.2% |
Class E | -19.03% | -33.98% | -34.83% | 700.4% | 601.9% |
Overall | -19.73% | -38.11% | -37.22% | 717.4% | 767.8% |
Class D | -23.76% | -35.64% | -36.67% | 715.2% | 1029.2% |
Class F | -27.42% | -42.56% | -42.93% | 613.6% | 631.9% |
Class TGM | -37.61% | -51.53% | -50.84% | 623.0% | 564.0% |
The rate reduction for natural sequences over VTM in RA configuration for {Y, U, V} increased from ECM-13.0’s {-25.51%, -25.80%, -28.72%} to ECM-14.0’s {-25.94%, -26.96%, -29.84%}. For SCC sequences (class TGM) the rate reduction for RA configuration increased from ECM-13.0’s {-40.63%, -45.97%, -46.06%} to ECM-14.0’s { -41.56%, -47.16%, -46.90%}.
- Contributions
In addition to 46 EE2 contributions, 50 (comparing to 46 last meeting) EE2-related and AHG12-related contributions were received. The EE2-related and AHG12-related contributions can be subdivided as follows:
- Intra (22)
JVET-AJ0087, "Non-EE2: Block vector guided DIMD", L. Zhang, Y. Yu, H. Yu, D. Wang (OPPO)
JVET-AJ0088, "Non-EE2: On MPM with matrix-based position dependent intra prediction", Z. Sun, Y. Yu, H. Yu, L. Xu, D. Wang (OPPO)
JVET-AJ0098, "Non-EE2: OBIC with improved sampling strategy and scaling weights", Y. Liu, Y. Huo (Transsion), G. Li, J. Chen, L. Luo, H. Guo, C. Zhu (UESTC)
JVET-AJ0102, "Non-EE2: Intra mode coding based on HoG of neighboring templates", M. Hong, J. Choi, J. Lim, S. Kim (LGE)
JVET-AJ0113, "Non-EE2: Intra OBMC", X. Li, R.-L. Liao, J. Chen, Y. Ye (Alibaba)
JVET-AJ0116, "Non-EE2: On interpolation filter selection for TIMD", Z. Zhang, J. Chen, X. Li, R.-L. Liao, Y. Ye (Alibaba)
JVET-AJ0118, "Non-EE2: Virtual intra prediction mode (VIPM) for chroma intra coding", J. Choi, M. Hong, J. Lim, S. Kim (LGE)
JVET-AJ0152, "AhG12: An alternative TIMD mode from common reference samples", H. Qin, K. Ding, J. Konieczny, A. Filippov, V. Rufitskiy, T. Dong (TCL)
JVET-AJ0155, "AhG12: SGPM Improvements", K. Ding, H. Qin, J. Konieczny, A. Filippov, V. Rufitskiy, T. Dong (TCL)
JVET-AJ0156, "Non-EE2 Adaptive interpolation filter for reference sample in angular mode", T. Dong, A. Filippov, J. Konieczny, H. Qin, K. Ding (TCL)
JVET-AJ0157, "Non-EE2: Template matching based jointly reordering for GPM split modes and partition indexes", C. Ma, X. Xiu, X. Wang (Kwai)
JVET-AJ0169, "Non-EE2: Improvement on non-MPM", G. Wang, C. Zhou, Z. Lv (vivo)
JVET-AJ0171, "Non-EE2: Weighted OBIC", P. Andrivon, M. Blestel, N. Zouidi (Ofinno)
JVET-AJ0194, "AHG12: Extended IntraTMP merge candidate list with an improved fusion mode", D. Ruiz Coll, J.-K. Lee (Ofinno)
JVET-AJ0216, "Non-EE2: On interpolation filter for intra template prediction", C. Zhou, Z. Lv, G. Wang (vivo)
JVET-AJ0217, "Non-EE2: Template-based intra interpolation filter", C. Zhou, Z. Lv, G. Wang (vivo)
JVET-AJ0218, "Non-EE2: Multiple filter taps for EIP", C. Zhou, Z. Lv, G. Wang (vivo)
JVET-AJ0223, "Non-EE2: Bilateral Filtering for Intra Prediction", W. Yin, K. Zhang, Y. Wang, Z. Deng, N. Zhang, L. Zhao, M. Salehifar, L. Zhang (Bytedance)
JVET-AJ0229, "EE2-related: Non-adjacent DIMD fusion modes for TMRL intra mode candidate list construction", V. Rufitskiy, A. Filippov, J. Konieczny, H. Qin, T. Dong, K. Ding (TCL)
JVET-AJ0230, "Non-EE2: Non-EE2: On reference sample processing for angular intra-prediction modes", A. Filippov, V. Rufitskiy, T. Dong, J. Konieczny, H. Qin (TCL)
JVET-AJ0269, "Non-EE2: OBIC extension with PDP and advanced sampling strategy", J. Fu, Z. Li, Y. Zhao, J. Zhang, C. Jia, S. Ma (PKU)
JVET-AJ0299, "AHG12: Intra TMP improvements", M. Radosavljević, F. Le Léannec, K. Naser, T. Dumas (InterDigital)
- Inter (5)
JVET-AJ0043, "Template Matching Picture Boundary Padding in ECM 14", N. Neumann, M. Wien (RWTH Aachen)
JVET-AJ0134, "Non-EE2: Enhanced derivation of affine merge candidates", L. Zhao, K. Zhang, Z. Deng, N. Zhang, Y. Wang, W. Yin, M. Salehifar, L. Zhang (Bytedance)
JVET-AJ0089, "Non-EE2: GPM extension", H. Zhang, F. Wang, Y. Yu, H. Yu, D. Wang (OPPO)
JVET-AJ0117, "Non-EE2: Regression-based GPM with intra and inter prediction", K. Jia, J. Chen, X. Li, R.-L. Liao, Y. Ye (Alibaba)
JVET-AJ0261, "Non-EE2: TMVP Candidate Selection", S. Hong, L. Wang, K. Panusopone (Nokia)
- In Loop Filters (6)
JVET-AJ0090, "AHG12: temporal ALF", L. Xu, Y. Yu, H. Yu, D. Wang (OPPO)
JVET-AJ0173, "AHG12: ALF-CCCM", P. Astola, I. Jumakulyyev, D. Bugdayci Sansli, J. Lainema (Nokia)
JVET-AJ0174, "Non-EE2: Laplacian Information for Adaptive Loop Filter", I. Jumakulyyev, D. Bugdayci Sansli, J. Funnel, J. Lainema (Nokia)
JVET-AJ0210, "AhG12: On In-Loop Filtering in ECM", D. Rusanovskyy, Y. Li, M. Karczewicz (Qualcomm)
JVET-AJ0224, "Non-EE2: Boundary-aware Offset Refinement for In-Loop-Filters", W. Yin, K. Zhang, Y. Wang, Z. Deng, N. Zhang, L. Zhao, M. Salehifar, L. Zhang (Bytedance)
JVET-AJ0276, "Non-EE2: Improvement to ALF scaling factor", M. Karczewicz, N. Hu, H. Wang, Y. Shao, V. Seregin (Qualcomm)
- Transform (4)
JVET-AJ0086, "Non-EE2: LFNST/NSPT set derivation for CCP coded block", H. Huang, Y. Yu, H. Yu, D. Wang (OPPO)
JVET-AJ0164, "AhG12: On advanced SBT with position and direction inference", G. Laroche, M. Rousselot, P. Onno (Canon)
JVET-AJ0255, "AHG12: Multiple transform set selection for intra LFNST/NSPT with subsampled DIMD for transform set selection", M. Coban, M. Karczewicz, P. Nikitin, P. Garus, B. Ray, V. Seregin (Qualcomm), F. Wang, Y. Yu, H. Yu, D. Wang (OPPO), C. Bonnineau, K. Naser, S. Puri, F. Le Léannec (InterDigital)
JVET-AJ0259, "EE2-related: On implicit MTS", M. Karczewicz, P. Garus, B. Ray, P. Nikitin (Qualcomm)
- Entropy Coding (2)
JVET-AJ0198, "AHG12: on residual coding in ECM", F. Le Léannec, M. Balcilar, C. Salmon-Legagneur, F. Galpin (InterDigital)
JVET-AJ0222, "Non-EE2: Additional contexts for CABAC", K. Zhang, Z. Deng, M. Salehifar, Y. Wang, W. Yin, N. Zhang, L. Zhao, L. Zhang (Bytedance)
- Inter and Intra (4)
JVET-AJ0078, "EE2-related: Extended overlapped block blending for MV/BV based prediction", Y. Kidani, H. Kato, K. Kawamura (KDDI)
JVET-AJ0196, "AHG12: Range-Exact signalling for adaptive luma clipping", D. Ruiz Coll, J.-K. Lee (Ofinno)
JVET-AJ0237, "AHG12: 12-bit internal bit depth for ECM", R. Yu, V. Seregin, M. Coban, M. Karczewicz (Qualcomm)
JVET-AJ0238, "AHG12: OBMC modifications", R. Yu, H. Huang, C.-C. Chen, V. Seregin, M. Karczewicz (Qualcomm)
- Encoder Optimization, CTC and Requirements (6)
JVET-AJ0226, "AHG12/AHG10: Using CABAC cost for MTT split modes selection", W. Ahmad, P. Wennersten, K. Andersson (Ericsson)
JVET-AJ0236, "Proposed additional requirements for the next generation video coding standard", S. Wenger (Tencent)
JVET-AJ0250, "AHG4/AHG12: New test sequences for ECM exploration", R.-L. Liao, Y. Ye (Alibaba)
JVET-AJ0251, "Proposed timeline and requirements for the next generation video coding standard", Y. Ye (Alibaba), M. Karczewicz (Qualcomm), M.-L. Champel (Xiaomi), P. Onno (Canon), L. Zhang (Bytedance), X. Wang (Kwai), Y. Yu (OPPO), J. Yuan (vivo), Y. Huo (Transsion), A. Luthra (Picsel Labs), E. François (InterDigital), H.-B. Teo (Panasonic), Y. Kidani (KDDI), S.-C. Lim (ETRI), D. Ruiz (Ofinno), F. Chen (Hikvision), W. Husak (Dolby), P. Wetzel (VITEC), J. Shingala (Ittiam), J.-H. Son (WILUS)
JVET-AJ0253, "Comments on setting a timeline for a next generation video coding standard", S. Wenger (Tencent), E. Alshina (Huawei), J. Lemotheux (Orange)
JVET-AJ0305, "AHG4/AHG12: Test Sequences Featuring User-Generated Contents", Z. Deng, Y. Wang, K. Zhang, L. Zhang (Bytedance)
JVET-AJ0321," AHG12: ECM complexity trade-offs", Y.-J. Chang, C.-C. Chen, M. Coban, K. Cui, P. Garus, N. Hu, H. Huang, M. Karczewicz, J.-L. Lin, P.-H. Lin, P. Nikitin, B. Ray, V. Seregin, G. Verba, H. Wang, E. Ye, R. Yu, Y. Zhang, Z. Zhang (Qualcomm)
- Recommendations
The AHG recommended to:
- To review all the related contributions.