Back to Search Document details
43rd Meeting: Geneva, July 2026
AHG9: On software availability and CTC results
Abstract
This contribution proposes rules for software available and CTC results of EE and TuC-related proposals.
JVET-AQ0238 AHG9: On software availability and CTC results [B. Kroon (Philips), G. Teniou (Tencent), J. Boyce (Nokia), L. Kerofsky (Qualcomm)] [late]

This contribution proposes rules for software available and CTC results of JEE and TuC-related proposals on GS related SEI messages. The establishment of such rules had been requested to be suggested during the joint AHG meeting on 12 July.

The following modified text based on further editing the proposal in JVET-AQ0238v2 was agreed:

For EE inclusion, a contribution should normally provide:

  1. a clear description of the proposed method;
  2. identification of the affected part of VSEI: syntax, semantics, generation of SEI parameters and input to video encoder, reconstruction of GS from video decoder output;
  3. software (source code);
  4. CTC results (when the proposal affects coding efficiency), by giving a complete reporting as per template, including objective quality, complexity per encoder/decoder runtime;
  5. enough information to reproduce the results, including software version, configurations, command lines, and test material;
  6. an indication of whether and how the result can be cross-checked.

For TuC inclusion of proposals that do not impact coding performance under CTC, A contribution should provide:

  1. complete proposed text of both syntax and semantics
  2. commitment to collaborate on software integration with the software coordinator, potentially with negotiated editing period on issues found in the merge request;
  3. software integration is handled by the software coordinator, with negotiated editing period, with support of proponents if multiple proposals are interacting;

For TuC inclusion of proposals that impact coding performance under CTC, the requirements should be stronger. A contribution should provide:

  1. complete proposed text, when syntax, semantics, decoding, conformance, or reconstruction are affected;
  2. software implemented in the VSEI reference software or an agreed branch by issuing a merge request;
  3. commitment to collaborate on software integration with the software coordinator, potentially with negotiated editing period on issues found in the merge request;
  4. CTC results on top of the applicable anchor (as per CTC or as defined in the JEE where the proposal was investigated);
  5. at least one successful cross-check confirming the reported results;
  6. a clear statement whether the proposal is to be enabled in CTC, integrated but disabled, included only for EE study, or included in the TuC.

As a general rule, positive discussion should not be sufficient for TuC inclusion if the required software, results, or cross-check are missing. In such cases, the outcome should normally be “further study,” with the missing evidence explicitly identified.

For training-dependent or implicit-representation proposals, the required software should include the complete pipeline needed to reproduce the coded representation and results, including training or model-generation steps when these affect the result.

For software-only or CTC/script changes, the contribution should show that the change is reproducible and should clearly state whether previous and new results remain comparable.

A possible compact rule could be:

A VSEI contribution that affects syntax, decoding, reconstruction, conformance, CTC results, or reference software operation should not be included in the TuC unless the corresponding text, software, CTC results, and appropriate cross-check evidence are available. For JEE inclusion, the same information is expected when applicable, but the group may allow earlier study inclusion if the missing items are explicitly identified.

Elements included in the TuC at prior meetings will be removed if the rules above are not followed, i.e. for elements included in JVET-AQ2032 this will apply in October.

  • Review of CTC N 826 was conducted, and some wording improvement on definition of anchors, and results to be delivered by proponents (to make comparison against anchors useful) were made
  • It was reported that proposals relating to V-PCC are mostly comparing against the V-PCC anchor, and the proposals relating to G-PCC are mostly comparing against the G-PCC anchor. Also here, the problem exists that V-PCC may perform better for some cases, and G-PCC for other.
  • The question had been raised in the JAHG meeting whether it would be useful to also define specific anchor(s) for SEI-based proposals.

The following proposal was agreed for anchors in the exploration:- JVET-AP0100- V-PCC GS (as per definition from WG 7 Amd1 development)- G-PCC GS (as per definition from WG 7 Amd1 development)

All anchors would be including adoptions of the current meeting (From joint activity, or WG 7 in case of V-PCC and G-PCC).

Joint meeting session 2 (Tue. 14 July 1600-1800)

Agenda for Tuesday:

  • Approve JAHG recommendations
  • Review JEE6.1 for potential new test sequences in CTC
  • Review mandates of next JAHG
  • Remaining 6.7
  • Review JEEs 6.3, 6.4, 6.5, 6.6, 6.2
  • CfP discussion planned on Wednesday with AG 5

An initial version of the JAHG report M77135 (elements collected and available in git) was presented

Regarding JAHG recommendations, aspects on general principles have already been conducted in the joint meeting on Monday (CTC, rules of implementation, reporting, etc.), or will be further conducted in the current or subsequent joint meetings.

Regarding recommendations made by the AHG that relate to SEI contributions, better coordination should be implemented how this is reaching the SEI experts in JVET.

All recommendations related to proposals on SEI-based technology were agreed in the joint meeting, except for aspects of JVET-AQ0167. This relates to the integer implementation of operations in the reconstruction pipeline that are currently implemented in floating point representation, which however comes with a loss of 0.5% in the results presented in the proposal.

This does not have impact on the current syntax and semantics of GSI. As long as the reconstruction process is not defined to be normative, it might even be possible to do reconstruction either by integer and floating point processing. It was agreed to adopt this to the software (also in SEI anchor).

Another revisit was found necessary on JVET-AQ0168. This proposes a conversion of quantization and transform parameters to integer representation in the syntax. The loss reported for JVET-AQ0167 also includes already this modification (separate impact of the two changes is unknown).

It was agreed to include the changes of JVET-AQ0168 in JVET-AQ2032 (next TuC), and also implement in software.

JEE6.1:

Presentation of following documents:

m77290 A-3DGS Dynamic Representation Sequences Generated using FreeTimeGS Kelei Liu, Lu Yu, Yiyi Liao

Presented on Tuesday 14 July

Investigation on conversion between I-3DGS and A-3DGS for current test material, generated with FreeTimeGS. The latter produces more compact Gaussian splats (total number of Gaussians below is for 32 frames each). In Manwithfruit, some artifacts are visible at object boundaries.

m78033 360-degree multiview basketball dataset for Gaussian Splat Coding Chao Wang, Jiayu Yang, Song Xu, Qi Wang, Ronggang Wang

Presented on Tuesday

Sports scene from stadium, captured by 36 fixed cameras, 700 frames at 25 fps. Metadata such as camera parameters, as well as the original camera captures would also be available.

For consideration in CfP (not in CTC at this meeting)

It was asked to provide usage/licensing conditions in an update of the contribution

Joint AHG mandates were discussed by the end of the meeting of Tuesday. It was agreed to keep the existing mandates 1-12 unchanged. A mandate 13 was agreed to be added to “coordinate the software integration of the codecs under investigation.”

Furthermore, the list of output documents (all to be made available as WG 5 outputs in the dms.mpeg.expert) was agreed as follows, including some minor updates of titles of JEEs (no new EE was introduced), as well as editing periods.

No.

Title

In Charge

TBP

Available

Explorations

  420  

  Common test conditions for Gaussian splat coding  

  Bart Kroon  

  N  

  2026-08-14  

  421  

Draft CfP of Gaussian splat coding  

  Ralf Schaefer  

  N  

2026-07-31  

  422  

Call for content for Gaussian splat coding

  Ralf Schaefer  

Y  

  2026-07-31  

  423  

  FAQ on Gaussian splat coding  

  Euee Jang  

  Y  

2026-09-11  

  424  

  JEE 6.1 on data preparation  

Patrice Rondao Alface  

  N  

  2026-08-14  

  425  

  JEE 6.2 on anchor generation  

  Gustavo Sandri  

  N  

  2026-08-14  

  426  

  JEE 6.3 on new coding technologies  

  Gun Bang  

  N  

  2026-08-14  

  427  

  JEE 6.4 on collecting requirements and use cases for Gaussian splat coding  

  Patrice Rondao Alface  

  N  

  2026-08-14  

  428  

  JEE 6.5 on 3DGS software  

  Julien Ricard  

  N  

  2026-08-14  

  429  

  JEE 6.6 on coordinating the 1F-geo Track  

  Hyejung Hur  

  N  

  2026-08-14  

  430  

  JEE 6.7 on video-based coding technologies  

  Yiyi Liao  

  N  

  2026-08-14  

  431  

  JEE 6.8 on Gaussian Splat Coding evaluation and CTC  

  Anthony Trioux  

  N  

  2026-08-14  

  432  

  JEE 6.9 on evaluation of encapsulation methods for Gaussian Splats  

  Joel Jung  

  N  

  2026-08-14  

Two more joint sessions were held on Wednesday 15 July 1600 and Thursday 16 July 1600, which from the perspective of JVET, after the closing of the JVET meeting, were already activities in the context of the Joint AHG. On behalf of JVET, these sessions were co-chaired by W. Husak. One major activity during these session was review of remaining documents submitted in the context of JEEs 6.1-6.6, as well as a one remaining document of JEE 6.7 (none of the reviewed documents related to study of SEI messages for Gaussian splats). The results of discussions during these sessions can be found in the JAHG report m77135.

Joint session 0830-0900 Tuesday 14 July on Joint Call for Proposals: MPEG WG 2 / Requirements, MPEG WG 5 / JVET, MPEG AG 5 Visual Quality Assessment, and ITU-T WP3/21)

This joint session was chaired by Jens-Rainer Ohm (JVET Chair and WG 5 Convenor), Justin Ridge WP3/21 Co-chair), Mathias Wien (AG 5 Convenor), and Igor Curcio (WG 2 Convenor).

This section is based on notes taken by JRO and Gary J. Sullivan (Q6/21 Rapporteur).

J. Ridge opened the meeting, mentioning that the meeting was requested by WP3/21, considering that the Joint CfP was planned to be issued as document by WP3/21.

M. Wien presented the latest draft of the CfP (JVET-AP2026v6 available as attachment in JVET-AQ0201).

It was discussed whether the selection of test model by October 2028 (as written in the timeline) would be not sufficiently ambitious, but as it is expressed as “at latest” and the timeline being tentative, that should not be a problem and not be changed.

It was discussed whether the statement about software availability would be sufficient, but as also the proposal description template contains a section where proponents need to unveil under which conditions their software would be available, and it is also expressed that it needs to be compatible with common patent policy and licensing rules imposed by ITU-T and ISO/IEC, this is asserted to be sufficient.

No issues were found in the presented document. The version presented should be prepared as output document JVET-AQ2021 and be delivered for final approval as WG 5 and WP3/21 documents.

Joint CfP to be approved in WP3/21 on Thursday.

Joint session 1535-1605 Tuesday 14 July on SEI messages for avatar coding: MPEG WG 5 / JVET, MPEG WG 3 Systems and MPEG WG 7 3D Graphics

This session was chaired by Jens-Rainer Ohm (JVET Chair and WG 5 Convenor), Marius Preda (WG 7 Convenor), and Thomas Stockhammer (on behalf of WG 3).

See notes under section 6.6.

BoGs (0)

Section kept as template for future use.

Liaison communications (3 incoming, 2 replies generated)

ISO/IEC JTC1/SC29/WG1-N101352 (SC29-N23183) LS on JPEG AI, also addressed to WG 5 as m78006

A draft response was presented by E. Alshina on Tuesday 14 July 0920-1000.

3GPP TSG SA4-S4-261360 LS on HEVC multi-layer profiles, chroma subsampling and bit depth combinations, also addressed to WG 5 as m77997

A draft response was presented by Y.-K. Wang on Tuesday 14 July 1000-1020.

Various further edits were made during the presentations of the drafts. The new versions of the documents were requested to be sent to JRO and GJS for further processing and forwarding for approval by SG21.

  • The drafts were forwarded for further processing in Q6/21, and issued as follows:
  • Liaison to JPEG on JPEG AI and explorations on video coding, included as item 1 in SG21 TD354/WP3
  • Liaison to 3GPP SA4 on HEVC multi-layer profiles, chroma subsampling and bit depth combinations, included as item 2 in SG21 TD354/WP3

Another liaison statement m77998 was addressed to WG 5 via SC 29 by SMPTE on SEI messages (no corresponding communication via SG21). It was informally inspected, and concluded that it does not need a response.

(kept for future use) The liaison response was also presented by XXXX in the MPEG AG 3 Communication meeting on Thursday XXXX during 1500 – 1700.

Project planning

Software timeline

The NNVC 18.0 codebase software was planned to be available 2 weeks after the meeting (31 July). Additional integration of various SADL aspects and harmonization with VTM may be done as appropriate in later versions.

Additional versions on top of VTM 24.0 may be released as appropriate.

An initial update on top of HM18.0 should be generated for submission of the ISO/IEC CD 23008-5 3rd within 2 weeks (July 31), integrating at least the elements for supporting new multiview profiles..

Further updates on top of HM18.0 and JM19.1 software were planned to be released later (integration and updates of SEI messages included in JVET-AN1018 and JVET-AN1017, and merging them with the new HEVC multiview software). Additional versions may be released as appropriate, also investigating the integration of full SHVC support in HM.

As a general rule in software development, a person who is executing a merge shall not be from the same company as the person who submitted that merge request.

Core experiment and exploration experiment planning

The exploration experiment on improved compression compared to VVC (EE2) had been discontinued by the 42nd meeting. At the 43rd meeting, the exploration experiment on neural network-based video coding (EE1) was discontinued as well.

Joint EEs on Gaussian splat technology are planned to be conducted within the Joint AHG. The proposals that are planned to be investigated are listed in the Joint AHG report JVET-AQ2019, as confirmed during joint meetings (see section 7.3.1). Technology related to SEI messages will be investigated in JEE 6.7 and JEE 6.9, based on common test conditions JVET-AQ2028. The JAHG was mandated to finalize the CTC document and the nine JEE descriptions during a telco on August 11, to be made available with an editing period until August 15 (description of JEEs which have relation to the investigation of performance and improvements of SEI messages will also be made available in JVET-AQ2040).

Drafting of specification text, encoder algorithm descriptions, and software

The following agreement has been established: the editorial team has the discretion to not integrate recorded adoptions for which the available text is grossly inadequate (and cannot be fixed with a reasonable degree of effort), if such a situation hypothetically arises. In such an event, the text would record the intent expressed by the committee without including a full integration of the available inadequate text.

Plans for improved efficiency and contribution consideration

The group considered it important to have the full design of proposals documented to enable proper study.

Adoptions need to be based on properly drafted working draft text (on normative elements) and HM/VTM encoder algorithm descriptions – relative to the existing drafts. Proposal contributions should also provide a software implementation (or at least such software should be made available for study and testing by other participants at the meeting, and software must be made available to cross-checkers in EEs).

Suggestions for future meetings included the following generally-supported principles:

  • Normative contributions (relating to changes in bitstream/decoder) shall include draft specification text
  • Proposals shall contain all details relevant for understanding and be self-contained. In cases where the document is a follow-up of a previous contribution, the overall concept and the novelties should be highlighted at minimum
  • Coding tool and encoder optimization proposals shall contain Excel sheets that allow assessment on a per-sequence basis
  • Algorithm description text is strongly encouraged for non-normative contributions that are intended to be included in model description documents (VTM, ECM, etc.), and that is required for inclusion in TR drafts.
  • Early upload deadline to enable substantial study prior to the meeting
  • Using a clock timer to ensure efficient proposal presentations (5 min) and discussions (not exercised currently)

As general guidance, it was suggested to avoid usage of company names in document titles, software modules etc., and not to describe a technology by using a company name.

General issues for experiments

It was emphasized that those rules which had been set up or refined during the 12th JVET meeting should be observed. In particular, for some CEs of some previous meetings, results were available late, and some changes in the experimental setup had not been sufficiently discussed on the JVET reflector.

Group coordinated experiments have been planned as follows:

  • “Core experiments” (CEs) are the coordinated experiments on coding tools which are deemed to be interesting but require more investigation and could potentially become part of a draft standard by the next meeting or in the near future.
  • “Exploration experiments” (EEs) are also coordinated experiments. These are conducted on technology which is not foreseen to become part of a draft standard in the near future. The investigating methodology for assessment of such technology can also be an important part of an EE. (Further general rules for EEs, as far as deviating from the CE rules below, should be discussed in a future meeting. For the current meeting, procedures as described in the EE description document are deemed to be sufficient.)
  • A CE is a test of a specific fully described technology in a specific agreed way. It is not a forum for thinking of new ideas (like an AHG). The CE coordinators are responsible for making sure that the CE description is complete and correct and has adequate detail. Reflector discussions about CE description clarity and other aspects of CE plans are encouraged.
  • A description of each experiment is to be approved at the meeting at which the experiment plan is established. This should include the issues that were raised by other experts when the tool was presented, e.g., interference with other tools, contribution of different elements that are part of a package, etc. The experiment description document should provide the names of individual people, not just company names.
  • Software for tools investigated in a CE will be provided in one or more separate branches of the software repository. Each CE will have a “fork” of the software, and within the CE there may be multiple branches established by the CE coordinator. The software coordinator will help coordinate the creation of these forks and branches and their naming. All JVET members will have read access to the CE software branches (using shared read-only credentials as described below).
  • During the experiment, revisions of the experiment plans can be made, but not substantial changes to the proposed technology. Withdrawing parts of experiments that were intended to show the individual benefits of a tool or parts of a tool is strongly discouraged. Combination tests may not be considered in such cases. Any changes made to individual tools in a combination shall be documented.
  • The CE description must match the CE testing that is done. The CE description needs to be revised if there has been some change of plans.
  • The CE summary report must describe any changes that were made in the process of finalizing the CE.
  • By the next meeting it is expected that at least one independent cross-checker will report a detailed analysis of each proposed feature that has been tested and confirm that the implementation is correct. Commentary on the potential benefits and disadvantages of the proposed technology in cross-checking reports is highly encouraged. Having multiple cross-checking reports is also highly encouraged (especially if the cross-checking involves more than confirmation of correct test results). In cases where combinations of different elements are planned to be tested, mutual cross-checking of the individual elements by other parties of the combination is discouraged. The combination must be cross-checked by an independent party. The reports of cross-checking activities may (and generally should) be integrated into the CE report rather than submitted as separate documents.
  • It is mandatory to report encoder optimizations made for the benefit of a tool, and if an equivalent optimization could be applied on the anchor, a comparison against the improved anchor shall be provided.
  • A new proposal can be included in a CE based on group decision, regardless if an independent party has already performed a cross-check in the meeting when it was first proposed.

It is possible to define sub-experiments within particular CEs, for example designated as CEX.a, CEX.b, etc., where X is the basic CE number.

As a general rule, it was agreed that each CE should be run under the same testing conditions using one software codebase, which should be based on the group test model software codebase. An experiment is not to be established as a CE unless there is access given to the participants in (any part of) the CE to the software used to perform the experiments.

The general agreed common conditions for single-layer coding efficiency experiments for SDR video are described in the prior output document JVET-AL2010.

Experiment descriptions should be written in a way such that it is understood as a JVET output document (written from an objective “third party perspective”, not a proponent perspective – e.g., not referring to methods as “improved”, “optimized”, “enhanced”, etc.). The experiment descriptions should generally not express opinions or suggest conclusions – rather, they should just describe what technology will be tested, how it will be tested, who will participate, etc. Responsibilities for contributions to CE work should identify individuals in addition to company names.

CE descriptions contain a basic description of the technology under test, but should not contain excessively verbose descriptions of a technology (at least not unless the technology is not adequately documented elsewhere). Instead, the CE descriptions should refer to the relevant proposal contributions for any necessary further detail. However, the complete detail of what technology will be tested must be available – either in the CE description itself or in documents that are referenced in the CE description that are also available in the JVET document archive.

Any technology must have at least one cross-check partner to establish a CE – a single proponent is not enough. It is highly desirable have more than just one proponent and one cross-checker.

The CE development workflow was previously described at:

https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/wikis/Core-experiment-development-workflow

However, it was noted that the link doesn’t seem to exist anymore.

CE read access is available using shared accounts: One account exists for MPEG members, which uses the usual MPEG account data. A second account exists for VCEG members with account information available in the TIES informal ftp area (IFA) system at:

https://www.itu.int/ifa/t/2017/sg16/exchange/wp3/q06/vceg_account.txt

Some agreements relating to CE activities were established as follows:

  • Only qualified JVET members can participate in a CE.
  • Participation in a CE is possible without a commitment of submitting an input document to the next meeting. Participation was requested by contacting the CE coordinator.
  • All software, results, and documents produced in the CE should be announced and made available to JVET in a timely manner.
  • A JVET CE reflector will be established and announced on the main JVET reflector. Discussion of logistics arrangements, exchange of data, minor refinement of the test plans, and preparation of documents shall be conducted on the JVET CE reflector, with subject lines prefixed by “[CEx: ]”, where “x” is the number of the CE. All substantial communications about a CE other than such details shall take place on main JVET reflector. In the case that large amounts of data are to be distributed, it is recommended to send a link to the data rather than the data itself, or upload the data as an input contribution to the next meeting.

General timeline for CEs

T1= 3 weeks after the JVET meeting: To revise the CE description and refine questions to be answered. Questions should be discussed and agreed on JVET reflector. Any changes of planned tests after this time need to be announced and discussed on the JVET reflector. Initially assigned description numbers shall not be changed later. If a test is skipped, it is to be marked as “withdrawn”.

T2 = Test model software release + 2 weeks: Integration of all tools into a separate CE branch of the VTM is completed and announced to JVET reflector.

  • Initial study by cross-checkers can begin.
  • Proponents may continue to modify the software in this branch until T3.
  • 3rd parties are encouraged to study and make contributions to the next meeting with proposed changes

T3: 3 weeks before the next JVET meeting or T2 + 1 week, whichever is later: Any changes to the CE test branches of the software must be frozen, so the cross-checkers can know exactly what they are cross-checking. A software version tag should be created at this time. The name of the cross-checkers and list of specific tests for each tool under study in the CE plan description shall be documented in an updated CE description by this time.

T4: Regular document deadline minus 1 week: CE contribution documents including specification text and complete test results shall be uploaded to the JVET document repository (particularly for proposals targeting to be promoted to the draft standard at the next meeting).

The CE summary reports shall be available by the regular contribution deadline. This shall include documentation about crosscheck of software, matching of CE description and confirmation of the appropriateness of the text change, as well as sufficient crosscheck results to create evidence about correctness (crosscheckers must send this information to the CE coordinator at least 3 days ahead of the document deadline). Furthermore, any deviations from the timelines above shall be documented. The numbers used in the summary report shall not be changed relative to the description document.

CE reports may contain additional information about tests of straightforward combinations of the identified technologies. Such supplemental testing needs to be clearly identified in the report if it was not part of the CE plan.

New branches may be created which combine two or more tools included in the CE document or the VTM (as applicable).

It is not necessary to formally name cross-checkers in the initial version of the CE description document. To adopt a proposed feature at the next meeting, JVET would like to see comprehensive cross-checking done, with analysis of whether the description matches the software, and a recommendation of the value of the tool and given tradeoffs.

The establishment of a CE does not indicate that a proposed technology is mature for adoption or that the testing conducted in the CE is fully adequate for assessing the merits of the technology, and a favourable outcome of CE does not indicate a need for adoption of the technology into a standard or test model.

Availability of specification text is important to have a detailed understanding of the technology and also to judge what its impact on the complexity of the specification will be. There must also be sufficient time to study this in detail. CE contributions without sufficiently mature draft specification text in the CE input document should not be considered for adoption.

Lists of participants in CE documents should be pruned to include only the active participants. Read access to software will be available to all members.

Establishment of ad hoc groups

The ad hoc groups established to progress work on particular subject areas until the next meeting are described in the table below. The discussion list for all of these ad hoc groups was agreed to be the main JVET reflector (jvet@lists.rwth-aachen.de).

Chairs of AHGs had been asked to send draft mandates to JRO before 1800 on 14 July, preferably copy from the table below and sending with changemarks or yellow highlight of changes.

Review of AHG plans was conducted during the plenary on Wednesday 15 July 2026 at 0905–1015.

Title and Email Reflector

Chairs

Interim mtg.

Project Management (AHG1)

(jvet@lists.rwth-aachen.de)

  • Coordinate overall JVET interim efforts.
  • Supervise AHG and experiment studies.
  • Report on project status to JVET reflector.
  • Provide a report to the next meeting on project coordination status.
  • Supervise processing and delivery of output documents.
  • Produce an update of the overview on IT systems JVET-AQ1012.

J.-R. Ohm, M. Wien (co-chairs), G. J. Sullivan (vice‑chair)

N

Draft text and test model algorithm description editing (AHG2)

(jvet@lists.rwth-aachen.de)

  • Produce and finalize draft text outputs of the meeting (JVET-AQ1006).
  • Collect reports of errata for VVC, VSEI, HEVC, AVC, CICP, and the published related technical reports.
  • Coordinate with AHG3 to address issues relating to mismatches between software and text.

B. Bross, C. Rosewarne (co-chairs), F. Bossen, A. Browne, S. Kim, S. Liu, J.‑R. Ohm, G. J. Sullivan, A. Tourapis, Y.-K. Wang, Y. Ye (vice‑chairs)

N

Test model software development (AHG3)

(jvet@lists.rwth-aachen.de)

  • Coordinate development of test models (VTM, HM, SCM, SHM, HTM, MFC, MFCD, JM, JSVM, JMVM, 3DV-ATM, 360Lib, and HDRTools) software and associated configuration files.
  • Prepare the draft of the next edition of HEVC reference software JVET-AQ1017.
  • Produce documentation of software usage for distribution with the software.
  • Enable software support for recently standardized additional SEI messages (for both VTM and HM), and SEI messages in TuC (the latter in a separate branch of VTM).
  • Discuss and make recommendations on the software development process.
  • Perform comparative tests of test model behaviour using common test conditions, including HDR, high bit depth and high bit rate.
  • Suggest configuration files for additional testing of tools.
  • Investigate how to minimize the number of separate codebases maintained for group reference software.
  • Coordinate with AHG2 to identify any mismatches between software and text, and make further updates and cleanups to the software as appropriate.
  • Prepare drafts of merged and updated CTC documents for HM and VTM, as applicable.

F. Bossen, X. Li, K. Sühring (co-chairs), E. François, Y. He, K. Sharman, V. Seregin, A. Tourapis (vice‑chairs)

N

Test material and visual assessment (AHG4)

(jvet@lists.rwth-aachen.de)

  • Maintain the video sequence test material database for testing the VVC and HEVC standards and potential future extensions, as well as exploration activities.
  • Study coding performance and characteristics of available and proposed video test material.
  • Identify and recommend appropriate test material for testing the VVC standard and potential future extensions, as well as exploration activities.
  • Identify and characterize missing types of video material, solicit contributions, collect, and make available a variety of video sequence test material, in coordination with other AHGs, as appropriate.
  • Maintain and update the directory structure for the test sequence repository, as necessary.
  • Collect information about test sequences that have been made available by other organizations.
  • Prepare and conduct expert viewing for purposes of subjective quality evaluation.
  • Coordinate with AG 5 in studying and developing further methods of subjective quality evaluation, e.g. based on crowd sourcing, as well as studying objective metrics in that context.
  • Coordinate with AHG18 on investigating visual impact of data losses.
  • Prepare availability of viewing equipment and facilities arrangements for future meetings.

V. Baroncini, T. Suzuki, M. Wien (co-chairs), W. Husak, S. Iwamura, P. de Lagrange, S. Liu, X. Meng, S. Puri, A. Segall, S. Wenger (vice-chairs)

Y (tel., 2 weeks notice)

Conformance testing (AHG5)

(jvet@lists.rwth-aachen.de)

  • Study the draft conformance bitstreams for new HEVC multiview profiles in JVET-AQ1008, and further develop related conformance bitstreams.
  • Prepare the draft of the next edition of HEVC conformance by integrating the relevant bitstreams from JVET-AQ1008.
  • Coordinate with AHG3 on implementation of the new HEVC multiview profiles.
  • Study the requirements of VVC, HEVC, and AVC conformance testing to ensure interoperability.
  • Maintain and update the conformance bitstream database, and contribute to report problems, and suggest actions to resolve these.
  • Study additional testing methodologies to fulfil the needs for VVC conformance testing.

I. Moccagatta (chair), F. Bossen, T. Ikai, S. Iwamura, H.-J. Jhu, K. Kawamura, P. de Lagrange, S. Paluri, K. Sühring, Y. Yu (vice‑chairs)

N

Non-reference software assets (AHG6)

(jvet@lists.rwth-aachen.de)

  • Collect a list of software assets available in JVET software repositories, which had been used during standards development or exploration efforts, but have not been made available as parts of reference software.
  • Propose actions to make such assets better visible and accessible for JVET members or to the public.

Y. Ye (chair), F. Bossen, R. Chernyak, P. de Lagrange, K. Sühring (vice‑chairs)

N

Tool assessment (AHG7)

(jvet@lists.rwth-aachen.de)

  • Investigate methodology of tool assessment, such as the aspects of memory access and bandwidth, number of maximum processing cycles, block decoding dependencies, number of context coded bins, pipeline and parallelization.
  • Study JVET-AO2040 and suggest improvements.
  • Prepare reporting of tool assessment results as applicable.
  • Develop methodology of more reliable runtime measurement.
  • Collaborate with AHG16 on encoding complexity assessment.

X. Li (chair), L.-F. Chen, Z. Deng, J. Gan, E. François, R. Ishimoto, H.-J. Jhu, J. Lainema, X. Li, J. Pardo, A. Stein, H. Wang (vice‑chairs)

Y (tel., 2 weeks notice)

SEI message studies (AHG9)

(jvet@lists.rwth-aachen.de)

  • Study the SEI messages in VSEI, VVC, HEVC and AVC.
  • Study JVET-AQ2006 and JVET-AQ2032, including study of SEI messages with different options (when present) and propose improvements.
  • Maintain the table of the summary of VSEI TuC status that is in an attachment of JVET-AQ2032, and generate a similar table for JVET-AQ2006.
  • Discuss and refine criteria for the assessment of SEI messages based on JVET-AQ0240.
  • Collect software and showcase information for SEI messages, including encoder and decoder implementations and bitstreams for demonstration and testing.
  • Identify potential needs for additional SEI messages.
  • Study SEI messages specified in HEVC and AVC for potential use in the VVC context and SEI messages in VSEI for potential use in the HEVC or AVC context.
  • Study the alignment of the same SEI messages in different standards.
  • Coordinate with AHG3 for software support of SEI messages for JM, HM, and VTM.
  • Coordinate with the joint AHG on Gaussian splat coding about the design and software implementation of the Gaussian splat coding related SEI messages in the TuC.

J. Boyce, Y.-K. Wang (co-chairs), T. Chujoh, S. Deshpande, M. M. Hannuksela, Y. He, P. de Lagrange, G. J. Sullivan, H. Tan, A. Tourapis, S. Wenger, P. Wu (vice-chairs)

N

Encoding algorithm optimization (AHG10)

(jvet@lists.rwth-aachen.de)

  • Study the impact of using techniques such as tool adaptation and configuration, and perceptually optimized adaptive quantization for encoder optimization.
  • Study the impact of non-normative techniques of preprocessing for the benefit of encoder optimization.
  • Study encoding techniques of optimization for objective quality metrics and their relationship to subjective quality.
  • Study optimized encoding for reference picture resampling and scalability modes in VTM.
  • Study optimized encoding and suitable test settings for noisy materials, such as sequences containing film grain.
  • Study optimized encoding and tool combinations for low latency and for low complexity.
  • Consider neural network-based encoding optimization technologies for video coding standards.
  • Investigate other methods of improving objective and/or subjective quality, including adaptive coding structures and multi-pass encoding.
  • Study methods of rate control and rate-distortion optimization and their impact on performance, subjective and objective quality.
  • Study the potential of defining default or alternate software configuration settings and test conditions optimized for either subjective quality, higher objective quality, or encoding with improved complexity/performance tradeoff, and coordinate such efforts with AHG3, AHG12, and AHG17.
  • Study the effect of varying configuration parameters depending on temporal layer, such as those related to deblocking, partitioning, chroma QP.

K. Andersson, P. de Lagrange, A. Duenas (co-chairs), T. Ikai, T. Solovyev, A. Tourapis (vice-chairs)

N

Neural network-based video coding (AHG11)

(jvet@lists.rwth-aachen.de)

  • Evaluate and quantify the performance improvement potential of NN-based video coding technologies compared to existing video coding standards such as VVC, including both individual coding tools, architectures and content adaptation with NN parameters overfitting.
  • Study potential improvements of the NNVC CTC document JVET-AP2016.
  • Study the impact of training (including the impact of loss functions) on the performance of candidate technologies and identify suitable material for testing and training. Promote the call for training materials, distribute it, and actively communicate with content owners.
  • Discuss and propose improved metrics to perform complexity analysis of NN architectures in preparation of the upcoming CfP, and develop complexity reductions of candidate technology.
  • Investigate device interoperability of NN-based methods on various platforms in coordination with AhG14.
  • Coordinate with other groups, including SC 29/AG 5 on the evaluation and assessment of visual quality, and with AHG12 on the interaction with ECM coding tools.
  • Coordinate with AHG14 on items related to NNVC software development, in particular, evaluate the interface in the NNVC for end-to-end optimized AI coded reference pictures.

E. Alshina, F. Galpin, S. Liu (co-chairs), J. Li, Y. Li, R.-L. Liao, M. Santamaria, T. Shao, M. Wien (vice-chairs)

Y (tel., 2 weeks notice), first on July 30

Enhanced compression beyond VVC capability (AHG12)

(jvet@lists.rwth-aachen.de)

  • Study non-neural-network video coding tools with enhanced compression capabilities beyond VVC.
  • Coordinate with AHG7 to study the performance and complexity tradeoff of video coding tools.
  • Support the ECM software coordinators in maintenance of the software, associated configuration files and documentation.
  • Identify any mismatches between the ECM20 software and the algorithm description JVET-AP2025, suggest updates and cleanups to the software as appropriate.

M. Karczewicz, Y. Ye, L. Zhang (co-chairs), B. Bross, R. Chernyak, X. Li, K. Naser, Y. Yu (vice-chairs)

N

Film grain technologies (AHG13)

(jvet@lists.rwth-aachen.de)

  • Study the benefits and characteristics of film grain technologies, including autoregressive and frequency-filtering technologies.
  • Propose refinements to the draft of the TR 2nd ed. JVET-AQ2020, and investigate for which additional elements described in the TR software might be attached.
  • Study alternative film grain models and their associated documentation.
  • In consultation with AHG4, study and define content characteristics and test conditions that are desirable for the study and testing of film grain technologies, and perform an assessment of newly available test materials in that regard.
  • Investigate metrics for measuring film grain fidelity in itself, or as present in a video.
  • Discuss the potential need for film grain conformance guidelines.
  • Study preprocessing and encoder technologies for determining values for FGC (Film Grain Characteristics) SEI message syntax elements.
  • Study Film grain region characteristics information SEI in JVET-AQ2006 and propose improvements as necessary
  • Identify potential need for additional film grain technology and signalling, if needed.
  • Coordinate development of film grain technology software and configuration files in coordination with AHG3.

W. Husak, P. de Lagrange (co-chairs), S. Deshpande, A. Duenas, X. Meng, M. Radosavljević, A. Segall, G. Teniou, A. Tourapis (vice-chairs)

Y (tel., 2 weeks notice)

NNVC software development (AHG14)

(jvet@lists.rwth-aachen.de)

  • Coordinate development of the NNVC software and associated configuration files.
  • Prepare and deliver NNVC-18.0 software version (and potential updates), based on updated VTM with adopted contributions and hybrid framework, and provide reference configuration encodings according to the NNVC common test conditions as described in JVET-AP2016. Study the impact of the addition of new dataset on the already integrated models.
  • Continue to bridge the gap between NNVC and most recent VTM as necessary.
  • Continue to develop missing functionalities for hybrid end-to-end framework exploration.
  • Investigate combinations of tools included in the NNVC software, prepare and release anchor data for all configurations of the software, including anchors for High and Low Operation Point (HOP/LOP) and Very Low Operation Point (VLOP) configurations.
  • Study and maintain the SADL (Small Adhoc Deep-Learning Library). Identify gaps in functionality and develop improvements as needed.
  • Coordinate with NNVC algorithm and software description (JVET-AQ2019) editors to identify any mismatches between software and description document, suggest further updates to the description document as appropriate.

F. Galpin (chair), R. Chang, A. Karabutov, Yue Li, Yun Li, M. Santamaria, J. N. Shingala, Z. Xie (vice-chairs)

Y (tel., 2 weeks notice), first on July 30

Gaming content compression (AHG15)

(jvet@lists.rwth-aachen.de)

  • Identify gaming content application scenarios and their requirements for codec operation.
  • Identify and characterize required types of content; solicit contributions, collect, and make a variety of gaming content available, in coordination with AHG4 and AG 5.
  • Produce VTM and ECM anchor encodings according to CTC JVET-AO2027, and provide test results at the next meeting.
  • Develop and maintain interfaces for supporting use cases of camera parameters and depth maps in gaming applications, including mechanisms for efficient transporting these elements in the coded video bitstream.
  • Develop and maintain software for estimation of depth maps for gaming sequences, and evaluate the effect of the estimated maps against the original depth maps on coding efficiency where they are available using established accuracy metrics
  • Evaluate JVET test models (such as ECM, VTM, NNVC, etc.) under the proposed test conditions.
  • Investigate possibilities to enhance compression capability for gaming content.
  • Investigate the possibility to estimate depth maps and camera parameters for those gaming sequences where they are not available.
  • Study conversion of depth maps using integer representation, and identifying efficient bit-depth resolution of depth maps to support identified use-cases that will be an input to compression.
  • Solicit contributions from industry on typical bitrate/quality/resolution used for gaming content compression.

C. Lehmann, S. Puri, J. Sauer (co-chairs), R. Chernyak, A. Duenas, L. Wang, V. Zakharchenko (vice-chairs)

N

Hardware implementation complexity (AHG16)

(jvet@lists.rwth-aachen.de)

  • Investigate hardware encoding complexity constraints in typical applications (e.g., mobile devices and hardware transcoding), and identify challenges and evaluate coding tools from hardware encoding implementation perspectives.
  • Solicit and develop hardware encoding complexity measurements (e.g., maximum number of RDO decisions per CU / CTU), and use them to analyse the performance of test models (e.g., VTM) and coding tools.
  • Design, develop and maintain a hardware-encoding-mimicking simulation framework on top of test models, e.g., constraining RDO number per CU, constraining coding tree decision complexity (e.g., maximum tree depth, per-node split modes), low-complexity CU/TU-level bit estimation function, etc.
  • Collaborate with AHG7 on aspects of hardware encoding and decoding complexity perspectives.

Y. Zhao, I. Moccagatta, K. Naser (co-chairs), H. Huang, T. Ikai, L. Li, X. Li, N. Song, G. Verba (vice-chairs)

Y (tel., 2 weeks notice)

Preparation of Call for Proposals (AHG17)

(jvet@lists.rwth-aachen.de)

  • Study the draft of the template for proposal description documents in JVET-AQ2022, and suggest updates as appropriate.
  • Study the complexity reporting template in JVET-AQ2022, suggest improvements, and prepare examples of the encoder complexity analysis for the case of VTM anchors in coordination with AHG7.
  • Coordinate with AG 5 on preparing logistics and organization of the visual assessment in the context of the CfP.

J.-R. Ohm, M. Wien, F. Bossen (co-chairs), E. Alshina, V. Baroncini, J. Chen, R. Chernyak, Z. Deng, P. de Lagrange, C. Lehmann, L. Li, P. Nikitin, D. Rusanovskyy, G. Verba (vice-chairs)

Y (tel., 2 weeks notice)

Ultra-low latency and packet loss resilience (AHG18)

(jvet@lists.rwth-aachen.de)

  • Study JVET-AN2039 common test conditions and propose improvements as appropriate.
  • Investigate creation of practical simulation software, including network transmission aspects, including consideration of network functionality that can aid timely video-coding based error correction, and conduct performance evaluation.
  • Identify potential requirements and feasibility of standard based technologies to support ultra-low delay requirements, including packet loss resilient decoding.
  • Investigate packet loss resilient technologies beyond VVC supporting ultra-low delay coding for interactive and live broadcasting scenarios.
  • Coordinate with AHG4 and AHG17 on investigating visual impact of data losses and appropriate evaluation procedure development.

S. Deshpande, S. Ikonin, V. Zakharchenko (co-chairs), S. Fößel, C. Kim, X. Ma, S. Puri, J. Ström, S. Wenger (vice-chairs)

Y (tel., 2 weeks notice)

As a follow-up of discussions conducted in previous meetings, it had been confirmed during the opening plenary on 7 July that it would be highly beneficial to make software that had been developed in various activities (AHGs, explorations conducted by JVET or previous joint teams, processing related to SEI messages, etc.) better visible, and potentially publicly available. It was suggested that a first step could be issuing a document which would summarize the existence of such JVET software assets, and indicate where these can be found. To take further action, it was agreed during the closing plenary on 15 July to establish a new AHG 6 on the topic of non-reference software assets, rather than making it an additional mandate of AHG3 (which is responsible for development of reference software).

It was confirmed that the rules which can be found in document ISO/IEC JTC 1/‌SC 29/‌AG 2 N 046 “Ad hoc group rules for MPEG AGs and WGs” (available at https://www.mpegstandards.org/adhoc/), are consistent with the operation mode of JVET AHGs. It is pointed out that JVET does not maintain separate AHG reflectors, such that any JVET member is implicitly a member of any AHG. This shall be mentioned in the related WG Recommendations. The list above was also issued as a separate WG 5 document (ISO/IEC JTC 1/‌SC 29/‌WG 5 N 418) in order to make it easy to reference.

A Joint AHG group was installed with ISO/IEC JTC 1/‌SC 29/‌WG 4 and ISO/IEC JTC 1/‌SC 29/‌WG 7 as follows (discussed and approved 1050-1100 on Wednesday 15 July). The last mandate was added, other mandates are identical to those of the last meeting cycle. Dates of meetings require updates, and other WGs are free in nominating their co-chairs until the end of their respective meetings.

Gaussian Splat Coding

(mpeg-gsc@lists.aau.at)

  • Discuss refinements of use cases and requirements for Gaussian splat coding
  • Improve and maintain datasets for Gaussian splat coding
  • Discuss possible refinements of common test conditions for Gaussian splat coding
  • Prepare anchors for Gaussian splat coding
  • Investigate new Gaussian splat representation and associated coding technologies
  • Consolidate the software tools for Gaussian splat coding
  • Coordinate the activity on Lightweight GS (1F)
  • Collaborate with AG 5 on preparation of subjective evaluation
  • Coordinate development of GS coding technology and its standardization across JVET, WG 4, and WG 7
  • Study encapsulation/high-level syntax technologies including those based on V-PCC, V3C, and VSEI.
  • Study GS technology that allows cross-encapsulation compatibility and definition of related conformance
  • Coordination of the preparation of the Call for proposal
  • Coordinate the software integration of the codecs under investigation.

Y. Liao, G. Bang (co-chairs on behalf of WG 4), J. Jung, W. Husak (co-chairs on behalf of JVET), A. Zaghetto, H. Hur (co-chairs on behalf of WG 7)

Y (tel., UTC)

Aug. 11 1400–1600

Aug. 25 2100–2300 (later cancelled)

Sep. 15 0500–0800

Oct. 6 1400–1700

Physical / remote access meeting on 17 and 18 October, full day each

The definition of the Joint AHG was issued as WG 5 N 419.

It is noted that only one instance of the joint AHG is routinely installed over all MPEG WGs, and at the current meeting, JVET WG 5 was responsible, as well as for managing all input and output documents of the joint activity.

JVET members are invited to subscribe to the reflector of this AHG via https://lists.aau.at/mailman/listinfo/mpeg-gsc.

GS content is stored at https://content.mpeg.expert/data/Explorations/GSC/CTC/

For accessing software, test materials and anchors, JVET members should contact the AHG chairs. In the next meeting, WG 7 will manage input and output documents of the joint activity. Documents relevant for usage of SEI messages in Gaussian splat representation should be submitted both as WG 7 documents and as JVET documents, such that JVET members who are participating via ITU also can get access. Documents not relevant for usage of SEI messages shall only be submitted as WG 7 documents.

For definition of joint exploration experiment on topics relevant for JVET, see section 8.2 of this report. CTC is available as JVET-AP2028 (duplicating N 420 of WG 5).

Output documents

The following documents were agreed to be produced or endorsed as outputs of the meeting. Names recorded below indicate the editors responsible for the document production. Where applicable, dates of planned finalization and corresponding parent-body document numbers are also noted.

It was reminded that in cases where the JVET document is also made available as a WG 5 output document, a separate version under the WG 5 document header should be generated. This version should be sent to GJS and JRO for upload.

The list of JVET ad hoc groups was also issued as a WG 5 output document WG 5 N 418, as noted in section 9.

A list of JVET-only output documents from the current meeting (including links to jvet-experts.org) was issued as a WG 5 document WG 5 N 417.

Decisions
A list of JVET-only output documents from the current meeting (including links to jvet-experts.org) was issued as a WG 5 document WG 5 N 417.
Citation