JVET-E0035 Enhanced Template Matching in FRUC Mode [Y. Lin, X. Chen, J. An, J. Zheng (HiSilicon)]
This contribution describes a change to FRUC template matching mode in JEM-4.0. An observation is that motion information derived by the existing uni-directional template matching is used for bi-prediction in the FRUC template matching mode, which is asserted to be unreasonable. This is proposed to be changed by the following proposed methods: 1) bi-directional template matching which jointly uses list0 and list1 reference pictures; 2) selection between uni-prediction and bi-prediction based on template matching distortion. Simulation results reportedly show that the proposed methods achieve 0.38% and 0.12% luma BD rate savings on average for RA and LDB configurations, respectively, with almost the same encoding and decoding time.
The method gives interesting gain, whereas encoder/decoder runtime is not increasing. One difference compared to current FRUC is the fact that the template-based search cannot be implemented in parallel but must be performed sequentially for the two reference pictures.
It was agreed to investigate this in an EE on decoder-side motion vector derivation, and to also investigate the relation with JVET-E0052 (especially with regard to whether the gains wil be additive).
JVET-E0035 Enhanced Template Matching in FRUC Mode [Y. Lin, X. Chen, J. An, J. Zheng (HiSilicon)]
Li Zhang was mandated to compile the EE document with remote assistance by Elena Alshina, to be circulated by Thursday and reviewed Friday.
It was agreed to give the editors the discretion to finalize the document during the two weeks after the meeting, and circulate/discuss it on the reflector appropriately.
Joint meetings
Joint meeting on evaluation of projections, Tuesday 0900–1000, of JCT-VC, JVET, VCEG, and MPEG Systems
See the JCT-VC report and the summary report JCTVC-Z0050 / JVET-E0137.
Joint meeting on projection format extensibility, Tuesday 1400–1500, of JCT-VC, VCEG, and MPEG Requirements, Systems, and Video
See the JCT-VC report.
Joint meeting on CfE preparation, Wednesday 1400–1500, of JVET with the VCEG and MPEG parent bodies
A draft preliminary CfE was presented with selection of test sequences and bit rates.
Testing of submissions was planned to be conducted by expert viewing.
No commitment was made that we will review all input, as we could get swamped.
A significant goal of the CfE is refinement of plans for a CfP.
Testing the JEM at the CfE stage as well as some proposals could provide a valuable reference point (as an additional anchor or a response).
(Potentially use the JEM bit rates as what should be matched.)
No fee was planned to be charged at the CfE stage.
Binary decoder and bitstreams are not necessary at CfE stage.
Just using the RA configuration for the CfE stage seems adequate.
Pre-/post- processing allowance – post-proc is allowed if part of decoding process. Perhaps allow for HDR and 360. Further study of this is desired.
It was agreed not to add WVGA and 720p to keep the effort manageable.
Joint meeting on CfE preparation and future video standardization, Thursday 1400–1500, of JVET with the VCEG and MPEG parent bodies
Further review and refinement of the planned preliminary CfE was conducted jointly; see the output document JVET-E1002.
BoGs