JVET-AF2024 Exploration experiment on enhanced compression beyond VVC capability (EE2) [V. Seregin, J. Chen, R. Chernyak, K. Naser, J. Ström, F. Wang, M. Winken, X. Xiu, K. Zhang] [WG 5 N 249] (2023-11-17)

An initial draft of this document was reviewed and approved at 0925-0935 on Friday 20 Oct.

Categories and experiments are listed in the subsequent table:

JVET-AF2024 Exploration experiment on enhanced compression beyond VVC capability (EE2) [V. Seregin, J. Chen, R. Chernyak, K. Naser, J. Ström, F. Wang, M. Winken, X. Xiu, K. Zhang] [WG 5 N 249] (2023-11-17)

An initial draft of this document was reviewed and approved at 0925-0935 on Friday 20 Oct.

Categories and experiments are listed in the subsequent table:

Tests

Tester

Cross-checker

1 Intra prediction

1.1a

Decoder derived CCP mode

Y.-J. Chang (Qualcomm)

1.1b

Test 1.1a with decoder derived CCP fusion modes

Y.-J. Chang (Qualcomm)

1.2

IntraTMP with merge candidates

K. Naser(InterDigital)

1.3

SGPM with IntraTMP and IBC

K. Naser

(InterDigital)

1.4

IntraTMP extension to DIMD

K. Naser

(InterDigital)

1.5

IntraTMP extension to LIC

F. Le Léannec

(InterDigital)

1.6

Test 1.4 + Test 1.5

F. Le Léannec

(InterDigital)

1.7

Test 1.6 + Test 1.3

K. Naser

(InterDigital)

1.8a

The length of the auto-relocated BVP trace path is 1 (i.e, n=1)

N. Zhang

(Bytedance)

1.8b

The length of the auto-relocated BVP trace path is 2 (i.e, n=2)

N. Zhang

(Bytedance)

1.8c

No constraint for the length of the auto-relocated BVP trace path

N. Zhang

(Bytedance)

1.9

Intra TMP fusion probing

J.-L. Lin

(Qualcomm)

1.10

Bilateral filtering for intra prediction

W. Yin

(Bytedance)

1.11a

IntraTMP search area extension with sampling factor proportional to CU distance

D. Ruiz Coll

(Ofinno)

1.11b

IntraTMP search area extension with sampling factor proportional to search area dimension

K. Naser

(InterDigital)

1.11c

Test 1.11a + Test 1.11b

D. Ruiz Coll

(Ofinno )

K. Naser

(InterDigital)

1.12a

IBC with extended reference area up to the picture’s upper side boundary

Y. Kidani

(KDDI)

1.12b

IBC with four CTU rows instead of two CTU rows in HD resolution or less

Y. Kidani

(KDDI)

1.13a

Test 1.11c + Test 1.12a

Y. Kidani

(KDDI)

D. Ruiz Coll

(Ofinno )

K. Naser

(InterDigital)

1.13b

Test 1.11c + Test 1.12b

Y. Kidani

(KDDI)

D. Ruiz Coll

(Ofinno )

K. Naser

(InterDigital)

1.14a

Encoder run-time reduction methods for extrapolation filter-based intra prediction mode only

L. Xu (OPPO)

1.14b

Encoder run-time reduction methods for extrapolation filter-based intra prediction and its merge mode

L. Xu (OPPO)

1.15a

CCP merge fusion

H. Huang

(OPPO)

Z. Deng

(Bytedance)

1.15b

Inheriting LB-CCP flag in CCP merge mode

H. Huang

(OPPO)

Z. Deng

(Bytedance)

1.15c

Test1.15a + Test1.15b

H. Huang

(OPPO)

Z. Deng

(Bytedance)

1.16

Slope adjustment for IBC LIC

C. Ma

(Kwai)

1.17a

IBC GPM with block vector difference

C. Ma

(Kwai)

1.17b

IBC GPM with split mode reordering

C. Ma

(Kwai)

1.17c

Test 1.17a + Test 1.17b

C. Ma

(Kwai)

1.18a

DIMD mode derivation from spatial blocks

J. Huo, J. Fan

(Xidian Univ.)

M. Li

(OPPO)

1.18b

DIMD mode derivation with reduced complexity

J. Huo, J. Fan

(Xidian Univ.)

M. Li

(OPPO)

1.19

IBC-LIC model merge mode

L. Zhang

(OPPO)

1.20a

TIMD fusion with non-angular predictor

P. Andrivon(Ofinno)

1.20b

Test 1.20a + TIMD sample-based fusion

P. Andrivon(Ofinno)

1.21

TIMD fusion reference line determination

C. Zhou(vivo)

1.22a

Test 1.20a + Test 1.21

P. Andrivon(Ofinno)

C. Zhou (vivo)

1.22b

Test 1.20b + Test 1.21

P. Andrivon(Ofinno)

C. Zhou(vivo)

2 Inter prediction

2.1

A LIC flag for inter prediction merge modes

Y. Zhang (Qualcomm)

2.2

Enable PU level BDMVR and BDOF for bi-predicted LIC

Y. Zhang (Qualcomm)

A. Robert (InterDigital)

2.3

LIC with multiple templates

Y. Wang

(Bytedance)

X. Xiu

(Kwai)

2.4

LIC with slope adjustment

Y. Wang

(Bytedance)

2.5

Non-local illumination compensation

X. Xiu

(Kwai)

2.6a

Test 2.1 + Test 2.2

Y. Zhang (Qualcomm)

2.6b

Test 2.3 + Test 2.4

Y. Wang

(Bytedance)

X. Xiu

(Kwai)

2.6c

Test 2.3 + Test2.5

X. Xiu

(Kwai)

Y. Wang

(Bytedance)

2.7

AMVP with SbTMVP mode

R.-L. Liao

(Alibaba)

2.8a

DMVR for non-equal POC distance cases

M. Salehifar

(Bytedance)

P. Le Guyadec (InterDigital)

2.8b

DMVR for non-equal POC distance cases with constraint

M. Salehifar

(Bytedance)

2.8c

BDOF layer with new subblock sizes including 16×16

M. Salehifar

(Bytedance)

2.8d

Mean removed formula for BDOF

M. Salehifar

(Bytedance)

2.8e

Test 2.8b + Test 2.8c + Test 2.8d

M. Salehifar

(Bytedance)

2.9

CIIP with subblock-based motion compensation

L. Zhao

(Bytedance)

2.10

GPM with affine prediction

K. Zhang

(Bytedance)

2.11

Regression-based GPM blending

P. Bordes

(InterDigital )

2.12

Utilizing LFNST/NSPT for inter coding

F. Wang

(OPPO)

F. Le Léannec (InterDigital)

2.13

Adjusting out-of-boundary prediction samples

P. Astola

(Nokia)

3 Transform and coefficients coding

3.1a

Intra contexts for intra CUs in inter slices

F. Lo Bianco (InterDigital)

3.1b

Test 3.1a + inter contexts for IntraTMP/IBC CUs

F. Lo Bianco (InterDigital)

3.1c

Test 3.1b without context switch for CBF

F. Lo Bianco (InterDigital)

3.1d

Test 3.1 with retrained context initialization of the affected by the test contexts

F. Lo Bianco (InterDigital)

3.2a

Transform coefficient coding

P. Nikitin

(Qualcomm)

3.2b

Test 3.2a with retrained context retrained context initialization

P. Nikitin

(Qualcomm)

4 In-loop filtering

4.1a

Adaptive clipping with signalled min/max values from MCTF prefiltered picture

K. Cui

(Qualcomm)

4.1b

Adaptive clipping with signalled min/max values from original picture

K. Cui

(Qualcomm)

4.2

Fixed filter for chroma ALF

N. Hu

(Qualcomm)

4.3

Coefficient precision adjustment for ALF

W. Yin

(Bytedance)

N. Hu

(Qualcomm)

5 Entropy coding

5.1

Retrain CABAC initialization parameters for all slices

F. Galpin

(InterDigital)

V. Seregin

(Qualcomm)

5.2

Window slice type-dependent offsets initialization

V. Seregin

(Qualcomm)

F. Galpin (InterDigital)

5.3a

Spatial CABAC tuning

J. Lainema

(Nokia)

5.3b

Spatial CABAC tuning in combination with retrained context initialization for inter slices

J. Lainema

(Nokia)