JVET-AP0197 AHG9: Shot summarization information SEI message [J. Boyce, M. M. Hannuksela (Nokia)]
Chaired by S. Deshpande from 14:35-15:05 CEST on 28 April 2026.
A shot summarization information SEI message is proposed to describe video “shots” to enable generation of a video summarization or highlights video. The description includes a shot ID, syntax to identify a representative picture (sometimes referred to as a “key frame”) and start and end pictures of the shot, and an optional shot highlight priority order,
Proponents commented that the main use case may be for archival. The highlights could be generated in a live scenario.
It was asked whether the SEI message would only be at the beginning or at an associated picture: it is flexible but intended to be at a representative picture (based on the flag) inside the shot.
It was commented that for high value content, providers may not provide such a flexible viewing information directly to the viewer. Also the currently proposed SEI may not directly enable streaming only parts of the video. Some verification from content providers or use case validation may be useful to decide what exactly may be useful to be signalled. It was also asked if file format may be a good location for this information. It was commented that for VVC the SEI messages could be collected in their own separate track compared to the VCL data. There may be “low profile” sports (e.g. high school or “division 3” sports) which may benefit from this.
It was asked if the HEVC scene information SEI message is used in real-world scenarios. And was commented that it was not in VVC/VSEI currently. That SEI message is clarified to be for a different use case.