JVET-AK0012 JVET AHG report: Enhanced compression beyond VVC capability (AHG12) [M. Karczewicz, Y. Ye, L. Zhang (co-chairs), B. Bross, R. Chernyak, X. Li, K. Naser, Y. Yu (vice-chairs)]
- Activities
The primary activity of the AHG was the “Exploration experiment on enhanced compression beyond VVC capability” (JVET-AJ2024). The combined improvements of the ECM-15.0 over VTM-11.0ecm15.0 anchor for AI, RA and LB configurations are:
All Intra Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | -14.31% | -15.16% | -26.55% | 1136.4% | 528.0% |
Class A2 | -20.82% | -23.47% | -27.99% | 1131.2% | 568.7% |
Class B | -14.38% | -21.88% | -19.73% | 1052.3% | 601.4% |
Class C | -14.30% | -11.21% | -12.34% | 1007.8% | 551.3% |
Class E | -18.63% | -21.83% | -20.07% | 995.7% | 623.0% |
Overall | -16.13% | -18.65% | -20.66% | 1058.7% | 575.3% |
Class D | -12.16% | -8.19% | -8.92% | 990.4% | 585.2% |
Class F | -29.93% | -33.46% | -33.65% | 744.5% | 672.5% |
Class TGM | -43.12% | -48.77% | -48.02% | 576.4% | 704.0% |
Random Access Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | -26.85% | -23.26% | -35.35% | 1016.7% | 1018.4% |
Class A2 | -30.05% | -33.22% | -38.66% | 1001.2% | 1201.5% |
Class B | -24.46% | -31.49% | -28.80% | 933.8% | 1077.1% |
Class C | -26.33% | -21.66% | -22.37% | 1003.4% | 1179.8% |
Class E | |||||
Overall | -26.55% | -27.57% | -30.37% | 981.8% | 1115.4% |
Class D | -27.14% | -22.16% | -23.42% | 949.0% | 1295.2% |
Class F | -32.70% | -34.86% | -35.64% | 870.5% | 827.1% |
Class TGM | -42.33% | -47.83% | -47.63% | 735.6% | 656.0% |
Low Delay B Main 10 | |||||
Y | U | V | EncT | DecT | |
Class A1 | |||||
Class A2 | |||||
Class B | -21.69% | -35.54% | -31.98% | 964.9% | 896.7% |
Class C | -24.13% | -24.52% | -26.26% | 917.1% | 969.2% |
Class E | -21.40% | -25.57% | -24.70% | 861.1% | 592.9% |
Overall | -22.43% | -29.37% | -28.26% | 922.1% | 829.8% |
Class D | -25.45% | -25.45% | -26.27% | 933.8% | 1110.6% |
Class F | -30.25% | -38.19% | -37.94% | 824.3% | 729.5% |
Class TGM | -40.56% | -50.17% | -50.03% | 740.4% | 622.4% |
The rate reduction for natural sequences over VTM in RA configuration for {Y, U, V} increased from ECM-14.0’s {-25.94%, -26.96%, -29.84%} to ECM-15.0’s {-26.55%, -27.57%, -30.37%}. For SCC sequences (class TGM) the rate reduction for RA configuration increased from ECM-14.0’s { -41.56%, -47.16%, -46.90%} to ECM-15.0’s { -42.33%, -47.83%, -47.63%}.
- Contributions
In addition to 39 EE2 contributions, 35 (comparing to 50 last meeting) EE2-related and AHG12-related contributions were received. The EE2-related and AHG12-related contributions can be subdivided as follows:
Intra (8)
JVET-AK0089, "Non-EE2: Improvement on MPM", G. Wang, C. Zhou, Z. Lv (vivo)
JVET-AK0090, "Non-EE2: IntraTMP complexity reduction", Z. Fan, T. Chujoh, T. Ikai (Sharp)
JVET-AK0171, "Non-EE2: Picture-level mirroring and rotation", D. Mieloch, M. Lorkiewicz, J. Stankowski (PUT)
JVET-AK0173, "Non-EE2: Adaptive picture-level vertical mirroring", D. Mieloch, M. Lorkiewicz, A. Dziembowski, J. Stankowski, D. Karwowski (PUT)
JVET-AK0202, "AHG12: On cross-component intra prediction", Y.-J. Chang, V. Seregin, M. Karczewicz (Qualcomm)
JVET-AK0223, "Non-EE2: CCP merge mode with adjustment", Y. Wang, K. Zhang, W. Yin, Z. Deng, N. hang, L. Zhao, M. Salehifar, L. Zhang (Bytedance)
JVET-AK0234, "Non-EE2: Subblock-based CCCM", F. Pu, N. C. Thuong, P. Yin, S. McCarthy (Dolby)
JVET-AK0262, "EE2-related: On EIP filter shapes", K. Panusopone, M. He, S. Hong, L. Wang, J. Lainema (Nokia)
Inter (12)
JVET-AK0096, "Non-EE2: Additional inter merge candidates", N. Zhang, K. Zhang, Z. Deng, L. Zhao, Y. Wang, W. Yin, M. Salehifar, L. Zhang (Bytedance)
JVET-AK0103, "Non-EE2: Template matching based jointly reordering for GPM split modes and partition indexes", C. Ma, X. Xiu, X. Wang (Kwai)
JVET-AK0108, "Non-EE2: CMVP extension for constructed affine merge candidates", C. Li, R.-L. Liao, J. Chen, Y. Ye (Alibaba)
JVET-AK0111, "Non-EE2: On interpolation filter for template matching", Z. Dai, R.-L. Liao, J. Chen, X. Li, Y. Ye (Alibaba)
JVET-AK0133, "Non-EE2: Improvements on the BV-based prediction in SGPM", J. Huo, Y. Fei, L. Wang, Y. Ma, F. Yang (Xidian Univ.)
JVET-AK0162, "AHG12: On affine motion compensation", H. Huang, R. Yu, Z. Zhang, Y. Zhang, V. Seregin, M. Karczewicz (Qualcomm)
JVET-AK0186, "Non-EE2: Subblock-based spatial MVP ", Z. Deng, K. Zhang, N. Zhang, L. Zhao, Y. Wang, W. Yin, M. Salehifar, L. Zhang (Bytedance)
JVET-AK0192, "Non-EE2: On Sample-Based BDOF", M. Salehifar, Y. He, K. Zhang, L. Zhao, Y. Wang, N. Zhang, Z. Deng, W. Yin, L. Zhang (Bytedance)
JVET-AK0199, "Non-EE2: MV refinement for TMVP", Z. Zhang, J.-L. Lin, Y. Zhang, H. Huang, V. Seregin, M. Karczewicz (Qualcomm)
JVET-AK0213, "AHG12: Extended BDOF usage for MV refinement", R. Yu, H. Huang, V. Seregin, M. Karczewicz (Qualcomm)
JVET-AK0225, "Non-EE2: Extension on spatial and temporal merge candidates", J.-L. Lin, P.-H. Lin, Z. Zhang, V. Seregin, M. Karczewicz (Qualcomm)
JVET-AK0254, "Case study of candidates in AMVP candidate list", Seori Park, Hyunki Jeong, Byeungwoo Jeon (SKKU)
In Loop Filters (7)
JVET-AK0113, "AHG12: On CCALF", L. Xu, Y. Yu, H. Yu, N. Song, D. Wang (OPPO)
JVET-AK0117, "Non-EE2: Neural network based loop filtering for ECM", Y. Du, A. Li, J. Liu, C. Zhu, L. Luo, H. Guo (UESTC), Y. Huo, Y. Liu (Transsion)
JVET-AK0132, "AHG12: Boundary strength adjustment for DBV mode", J. Huo, J. Fan, Y. Fei, J. Liu, Y. Ma, F. Yang (Xidian Univ.)
JVET-AK0184, "EE2-related: Additional results for NN-based ILF in ALF", D. Rusanovskyy, Y. Li, M. Karczewicz (Qualcomm)
JVET-AK0200, "Non-EE2: CCSAO with reused CTU control and extended edge classifier", C.-W. Kuo, X. Xiu, X. Wang (Kwai)
JVET-AK0224, "Non-EE2: Cross-Chroma Adaptive Loop-Filter", W. Yin, K. Zhang, H. Liu, Y. Wang, Z. Deng, N. Zhang, L. Zhao, M. Salehifar, L. Zhang (Bytedance)
JVET-AK0237, "Non-EE2: CCALF with dual-chroma inputs", C. Ma, X. Xiu, C.-W. Kuo, X. Wang (Kwai)
Transform (2)
JVET-AK0214, "Non-EE2: IntraNN NSPT set", G. Verba, M. Coban, V. Seregin, M. Karczewicz (Qualcomm)
JVET-AK0215, "Non-EE2: MTS with reduced memory ", B. Ray, V. Seregin, M. Karczewicz (Qualcomm)
Entropy Coding (3)
JVET-AK0135, "AhG12: CABAC contexts retraining F. Galpin (Interdigital)
JVET-AK0174, "Non-EE2: Optimization of probability estimation in CABAC", D. Karwowski, D. Mieloch, M. Lorkiewicz (PUT)
JVET-AK0279, "Non-EE2: On coefficient level binarization in Transform Skip", M. Abdoli, R. G. Youvalari, F. Plowman, A. Tissier (Xiaomi)
Partitioning (1)
JVET-AK0219, "Non-EE2: Chroma partition prediction in separate tree condition", P.-H. Lin, J.-L. Lin, V. Seregin, M. Karczewicz (Qualcomm)
CTC and Requirements (2)
JVET-AK0201, "On additional operation point for the exploration model", T. Solovyev, J. Pardo, J. Sauer, Z. Li, E. Alshina (Huawei)
JVET-AK0232, “On real-time test condition for limited uplink/storage use case and MTT depth suggestions on common test condition”, T. Ikai (Sharp)
- Recommendations
The AHG recommended:
- To review all the related contributions.