Search Results for "JVET-R2009"

Found 9 document(s)

Search documents

Use number, keyword, author, or MPEG number. Filter by meeting when needed.

Not signed in yet.
Showing 1-9 of 9 result(s)
18th Meeting: Teleconference, April 2020 2020-05-02 16:07
Draft plan for VVC verification testing (Draft 2)
Authors: Mathias Wien V. Baroncini Andrew Segall Y. Ye Jens-Rainer Ohm
Abstract
This document contains the draft plan for the video verification test to be conducted to verify the coding performance of the VVC Main profile. A formal subjective evaluation will be conducted comparing the VVC Main profile to the HEVC Main 10 profile.
Meeting Notes
JVET-R2009 Draft plan for VVC verification testing (Draft 2) [M. Wien, V. Baroncini, A. Segall, Y. Ye] [WG 11 N 19200] (2020-05-01)

See notes in section 4.4.

Remains valid – not updated: JVET-N1010 JVET common test conditions and software reference configurations for SDR video [F. Bossen, J. Boyce, X. Li, V. Seregin, K. Sühring] (2019-04-12)
Remains valid – not updated: JVET-P2011 JVET common test conditions and evaluation procedures for HDR/WCG video [A. Segall, E. François, W. Husak, S. Iwamura, D. Rusanovskyy] (2019-07-31)
Remains valid – not updated: JVET-L1012 JVET common test conditions and evaluation procedures for 360° video [P. Hanhart, J. Boyce, K. Choi, J.-L. Lin] (2018-10-26)

JVET-R2009 Draft plan for VVC verification testing (Draft 2) [M. Wien, V. Baroncini, A. Segall, Y. Ye] [WG 11 N 19200] (2020-05-01)

See notes in section 4.4.

Remains valid – not updated: JVET-N1010 JVET common test conditions and software reference configurations for SDR video [F. Bossen, J. Boyce, X. Li, V. Seregin, K. Sühring] (2019-04-12)

Remains valid – not updated: JVET-P2011 JVET common test conditions and evaluation procedures for HDR/WCG video [A. Segall, E. François, W. Husak, S. Iwamura, D. Rusanovskyy] (2019-07-31)

Remains valid – not updated: JVET-L1012 JVET common test conditions and evaluation procedures for 360° video [P. Hanhart, J. Boyce, K. Choi, J.-L. Lin] (2018-10-26)

References:
JVET-P2011
Cited:
JVET-R0461 JVET-S0001 JVET-S0004 JVET-S0041 JVET-S0146 JVET-S0151 JVET-S0246
ARCHIVE v1 :
JVET-R2009.docx JVET-R2009_RDdata_SDR-xml.zip JVET-R2009_RDdata_SDR.xlsx
Decisions
JVET-R2009 Draft plan for VVC verification testing (Draft 2)
Remains valid – not updated: JVET-L1012 JVET common test conditions and evaluation procedures for 360° video [P. Hanhart, J. Boyce, K. Choi, J.-L. Lin] (2018-10-26)
Citation
19th Meeting: by teleconference, June 2020 2020-06-18 22:33
Results of dry run subjective assessment of SDR UHD verification test
Authors: V. Baroncini Mathias Wien
Abstract
The draft plan for VVC verification testing (Draft 2) [JVET-R2009] includes a set of UHD SDR test sequences under consideration for use in the formal verification tests of VVC. According to the timeline of this plan, a preselection and preparation of test sequences and corresponding rate points for viewing has been carried out as described in document JVET-S0041. Out of the 13 test sequences listed in JVET-R2009, 8 test sequences were selected. The selection process and the experts viewing session subsequently conducted are described in this document. Starting from the selection described in JVET-S0041, a set of 4 test sequences were selected to run a Dry Run formal subjective assessment. A set of 5 rate points was selected for the assessment of each test sequence. The results indicate that the selected rate points cover the intended MOS range for most of the test sequences. Modifications and improvements to the set of test sequences and to the VTM and HM QP selection are suggested.
Meeting Notes
JVET-S0246 Results of dry run subjective assessment of SDR UHD verification test [V. Baroncini, M. Wien]

The draft plan for VVC verification testing (Draft 2) [JVET-R2009] included a set of UHD SDR test sequences under consideration for use in the formal verification tests of VVC. According to the timeline of this plan, a preselection and preparation of test sequences and corresponding rate points for viewing has been carried out as described in document JVET-S0041. Out of the 13 test sequences listed in JVET-R2009, 8 test sequences were selected. The selection process and the experts viewing session subsequently conducted are described in this document. Starting from the selection described in JVET-S0041, a set of 4 test sequences were selected to run a Dry Run formal subjective assessment. A set of 5 rate points was selected for the assessment of each test sequence. The results indicate that the selected rate points cover the intended MOS range for most of the test sequences. Modifications and improvements to the set of test sequences and to the VTM and HM QP selection are suggested.

This was presented Tue 06-23 1455 UTC (chaired by JRO).

Some alignment of rate points for Neptune Fountain, where VTM saturates at highest rate. More intermediate points, and/or slightly lower lowest rate point.

It is also observed that in many cases where VTM is slightly worse in PSNR, it is slightly better in MOS, which seems to indicate that subjective benefit over HEVC is larger than PSNR benefit.

It is also suggested that a fifth sequence (Tall Buildings) should be used in the final...

References:
JVET-R2009 JVET-S0041
Cited:
JVET-S0004 JVET-S0253
ARCHIVE v1 :
JVET-S0246.docx
Decisions
It is also suggested that a fifth sequence (Tall Buildings) should be used in the final verification test.
Citation
18th Meeting: Teleconference, April 2020 2020-04-16 20:44
AHG4: Candidate test sequences for verification tests
Authors: Mathias Wien RWTH V. Baroncini
Abstract
This document discussed the suitability of SDR test sequences in UHD resolution for usage in the VVC verification tests according to the draft verification test plan described in JVET-R2009. Available test sequences are collected and characterized by means of RD measurements based on HM16.20 in RA configuration and visual inspection. A number of about seven sequences is identified to be inspected further. A method is suggested to perform online viewing sessions in order to proceed in the selection process during the meeting. It is noted that the collection of sequences reported in this document only addresses the SDR UHD test case so far. Contributions and suggestions from JVET experts are solicited, including potential test sequences, but also support with VTM simulations.
Meeting Notes
JVET-R0461 AHG4: Candidate test sequences for verification tests [M. Wien (RWTH), V. Baroncini (VABTECH)] [late]

This document discussed the suitability of SDR test sequences in UHD resolution for usage in the VVC verification tests according to the draft verification test plan described in JVET-R2009. Available test sequences are collected and characterized by means of RD measurements based on HM16.20 in RA configuration and visual inspection. A number of about seven sequences is identified to be inspected further. A method is suggested to perform online viewing sessions in order to proceed in the selection process during the meeting. It is noted that the collection of sequences reported in this document only addresses the SDR UHD test case so far. Contributions and suggestions from JVET experts are solicited, including potential test sequences, but also support with VTM simulations.

This was discussed Sunday 19 Apr. 0500–0620 in Track B (chaired by JRO). Follow-up discussion was planned for Wednesday after the MPEG plenary.

Verification Test should be done with at most 8 sequences per test case, this document proposes a pre-selection for UHD SDR. In SDR, there should be perhaps 5 UHD and 5 HD

Range of qualities should be selected such that at the highest point VVC would be quasi transparent, and HEVC would still have artefacts. Lowest point should be still somewhat acceptable quality for VVC.

It is suggested to have more (perhaps 5) points within that range.

For determining rate savings, it would be best to have same range of qualities for both codings. Another...

References:
JVET-G0096 JVET-R2009
Cited:
JVET-R0004
ARCHIVE v1 :
JVET-R0461.docx
Decisions
For 360, it should be clarified if padding can be used for CMP-like formats, to avoid visibility of face boundaries. For fair comparison, this should be used for both codecs. It should be clarified whether an implementation exists for such a mechanism in HEVC (per SEI messages, it should be possible), or if it could be mimicked but using 360lib.
Citation
19th Meeting: by teleconference, June 2020 2020-06-23 19:06
Status Report on SDR Verification Test Preparation
Authors: Mathias Wien RWTH V. Baroncini VABTech
Abstract
The draft plan for VVC verification testing (Draft 2) [JVET-R2009] includes a set of SDR test sequences under consideration for use in the formal verification tests of VVC. According to the timeline of this plan, a preselection and preparation of test sequences and corresponding rate points for viewing has been carried out. Out of the 13 test sequences listed in JVET-R2009, 8 test sequences were selected. The selection process and the experts viewing session subsequently conducted are described in this document.
Meeting Notes
JVET-S0041 Status Report on SDR Verification Test Preparation [M. Wien (RWTH), V. Baroncini (VABTECH ltd)] This had been presented in the AHG meeting on 05-15.
References:
JVET-B0046 JVET-R2009
Cited:
JVET-S0004 JVET-S0246 JVET-S0253
ARCHIVE v3 :
JVET-S0041-v2.docx JVET-S0041-v3.docx JVET-S0041.docx
Decisions
This had been presented in the AHG meeting on 05-15.
Citation
19th Meeting: by teleconference, June 2020 2020-06-22 11:17
JVET AHG report: Test material and visual assessment (AHG4)
Authors: V. Baroncini Teruhiko Suzuki Mathias Wien Andrey Norkin Andrew Segall Y. Ye Jens-Rainer Ohm
Abstract
Produce the draft verification test plan JVET-R2009 and develop proposed improvements for verification testing of VVC capability.
Meeting Notes
JVET-S0004 JVET AHG report: Test material and visual assessment (AHG4) [V. Baroncini, T. Suzuki, M. Wien, A. Norkin, A. Segall, Y. Ye] Dedicated AHG meeting sessions were held on 2020-05-15 for SDR [JVET-S0041, JVET-S0043], on 2020-05-27 for 360° video [JVET-S0146, JVET-S0149], and on 2020-05-29 for HDR [JVET-S0151, JVET-S0153]. In the SDR category, a close-to-final definition of test sequences and selection of rate points for VTM and HM in the UHD Random Access test case are presented. For the HD Low Delay test case, the identification of test sequences is in progress. For the HDR category, a candidate set of five QP and five HLG sequences with corresponding QP settings are proposed for visual inspection. A tone mapping procedure has also been determined to enable the viewing of the PQ content on available UHD displays. In the 360° video category, viewpaths have been designed. The appli...
References:
JVET-R2009 JVET-S0041 JVET-S0043 JVET-S0146 JVET-S0149 JVET-S0151 JVET-S0153 JVET-S0218 JVET-S0246 JVET-S0253
ARCHIVE v1 :
JVET-S0004.docx
Decisions
Camera-captured 4:4:4 content
Citation
19th Meeting: by teleconference, June 2020 2020-07-10 19:25
Working practices using objective metrics for evaluation of video coding efficiency experiments (Draft 3)
Authors: K. Andersson Frank Bossen Jens-Rainer Ohm Andrew Segall Rickard Sjöberg J. Ström Gary J. Sullivan Alexis M. Tourapis Gary Sullivan
Abstract
This document provides a description of Bjøntegaard Delta rate (BD-rate) measurement practices for video coding experiments. It provides a concept-level overview of recent practices and provides references to technical papers that describe further details. It provides comments on why some of the choices were made and identifies situations where caution must be taken when interpreting the results. Revision marks are shown relative to the April 2020 output document, JVET-R2016-v1.
Meeting Notes
JVET-S2016 Working practices using objective metrics for evaluation of video coding efficiency experiments (Draft 3). For the organization and planning of its future work, the JVET established 13 “ad hoc groups” (AHGs) to progress the work on particular subject areas. At this meeting, no Core Experiments (CE) were defined. The next four JVET meetings were planned for 7–9 and 12–16 October 2020 under WG 11 auspices as a teleconference meeting, during 8–15 January 2021 under WG 11 auspices in Capetown, ZA, during 21–28 April 2021 under ITU-T SG16 auspices in Geneva, CH, and during 9–16 July 2021 under WG 11 auspices in Prague, CZ. The document distribution site http://phenix.int-evry.fr/jvet/ was used for distribution of all documents. The reflector to be used for discussions by the JVET and all its AHGs is the JVET reflector:jvet@lists.rwth-aachen.de hosted at RWTH Aachen University. For...
References:
JCTVC-G1200 JVET-H0030 JVET-M1004 JVET-O0003 JVET-P2011 JVET-Q0826 JVET-R2016
Cited:
JVET-T0001 JVET-T0097 JVET-T0103 JVET-T2009 JVET-T2016 JVET-U0002 JVET-U2021 JVET-V0174 JVET-V2021 JVET-W0145
ARCHIVE v1 :
JVET-S2016-v1.docx
Decisions
”
Minor refinements of the description.
Citation
19th Meeting: by teleconference, June 2020 2020-06-22 15:47
JVET AHG report: Project management (AHG1)
Authors: Jens-Rainer Ohm Gary J. Sullivan
Abstract
This document reports on the work of the JVET ad hoc group on Project Management, including an overall status report on the VVC standardization project and the progress made during the interim period since the preceding meeting.
Meeting Notes
JVET-S0001 JVET AHG report: Project management (AHG1) [J.-R. Ohm, G. J. Sullivan] This document reports on the work of the JVET ad hoc group on Project Management, including an overall status report on the VVC standardization project and the progress made during the interim period since the preceding meeting. The number of subscribers (by the beginning of the current meeting) was 1251. The work of the JVET overall had proceeded well in the interim period with a moderate number of input documents submitted to the current meeting. Intense discussion had been carried out on the group email reflector, and all output documents from the preceding meeting had been produced. Output documents from the preceding meeting had been made available at the "Phenix" site (http://phenix.int-evry.fr/jvet/) or the ITU-based JVET site (http://wftp3.itu.int/av-arch/jvet-site/2020_04_ R_Alpbach/), particularly...
References:
JVET-R2000 JVET-R2001 JVET-R2002 JVET-R2005 JVET-R2007 JVET-R2008 JVET-R2009 JVET-R2013 JVET-R2016 JVET-S0137 JVET-S0237
ARCHIVE v2 :
JVET-S0001-v2.docx
Decisions
A preliminary basis for the document subject allocation and meeting notes for the 19th meeting had been made publicly available on the ITU-hosted ftp site http://wftp3.itu.int/av-arch/jvet-site/2020_06_S_Virtual/.
Citation
18th Meeting: Teleconference, April 2020 2020-05-17 19:13
Summary information on BD-rate experiment evaluation practices
Authors: K. Andersson Frank Bossen Jens-Rainer Ohm Andrew Segall Rickard Sjöberg J. Ström Gary J. Sullivan Alexis M. Tourapis
Abstract
This document provides general summary information about typical quality measurement practices for video coding experiments in recent work in MPEG and VCEG and their JVET and JCT-VC joint teams. In particular, it describes the use of Bjøntegaard Delta rate (BD-rate) measurements. It aims at providing a concept-level overview of recent practices and to provide some references to technical papers that describe further details. It provides comments on why some of the choices were made and points at situations where caution must be taken when interpreting the results. Revision marks are shown relative to the January 2020 output document, JVET-Q2016-v4.
Meeting Notes
JVET-R2016 Summary information on BD-rate experiment evaluation practices. For the organization and planning of its future work, the JVET established 17 “ad hoc groups” (AHGs) to progress the work on particular subject areas. At this meeting, no Core Experiments (CE) were defined. The next four JVET meetings were planned for 23 June – 1 July 2020 under ITU-T SG16 auspices in Geneva, CH, during 7–16 October 2020 under WG 11 auspices in Rennes, FR, during 6–15 January 2021 under WG 11 auspices in Capetown, ZA, and during 20–28 April 2021 under ITU-T SG16 auspices in Geneva, CH. The document distribution site http://phenix.int-evry.fr/jvet/ was used for distribution of all documents. The reflector to be used for discussions by the JVET and all its AHGs is the JVET reflector:jvet@lists.rwth-aachen.de hosted at RWTH Aachen University. For subscription to this list, seehttps://lists.rwth-aache...
References:
JCTVC-G1200 JVET-H0030 JVET-M1004 JVET-O0003 JVET-P2011 JVET-Q2016
Cited:
JVET-AA0130 JVET-AA2018 JVET-S0001 JVET-S2016 JVET-T2016 JVET-U2018
ARCHIVE v1 :
JVET-R2016-v1.docx
Decisions
”
Tianyang Zhou (Sharp)
Citation
18th Meeting: Teleconference, April 2020 2020-04-17 17:06
Crosscheck of JVET-R0328 (AHG 10: ALF and CCALF encoder parallel design)
Authors: G. Li Tencent Guichun Li
Abstract
This document reports the crosscheck results for JVET-R0328 "AHG 10: ALF and CCALF encoder parallel design". The software was studied, and the implementation is as described in JVET-R0328. The simulation results match with the results provided by the proponent.
Meeting Notes
JVET-R0465 Crosscheck of JVET-R0328 (AHG 10: ALF and CCALF encoder parallel design) [G. Li (Tencent)] [late] Metrics and evaluation criteria (0) No contributions on this topic were noted. Plenary meetings, joint meetings, BoG reports, and summary of actions taken High-level syntax / systems relation meeting This previously planned coordination session was cancelled due to a lack of identified need. Plenary meeting Sunday 19 April 1300-1500 Reports of the tracks were presented as follows: The status of Tracks A and B was presented and discussed, which particularly included the following aspects: Track A: Status of HLS review: By the end of April 18, 2020, the meetings had reviewed approximately 172 (70%) of the 254 contributions, which resulted in 65 recommendations/adoptions for normative action, 26 recommendations/adoptions for editorial action, and 25 revisits. 6.1.1 Combinations of su...
References:
JVET-N1010 JVET-R0328
ARCHIVE v1 :
JVET-R0465.docx JVET_VTM8_R0328_crosschecker.XLSM
Decisions
It was reminded that in cases where the JVET document is also made available as MPEG output document, a separate version under the MPEG document header should be generated. This version should be sent to GJS and JRO for upload.
Citation
New Search