JVET-AQ0176 AHG9: Display rectangles (DR) SEI message for VSEI v5 WD [J. Boyce, M. M. Hannuksela, T. Biatek (Nokia), Y. He, S. Zhao, L. Kerofsky (Qualcomm), H. Tan, C. Kim, J. Lee (LGE), R. Imichi, Y. Tokumo, T. Ikai (Sharp)]
The DR SEI message was first proposed in January 2025 in contribution JVET-AK0142 and added to the VSEI TuC document output from that meeting. Multiple improvements, including additional features, have since been added to the DR SEI message design in the TuC, as included in JVET-AP2032. A showcase for the DOI SEI message was provided in JVET-AL0141.
Popular video streaming/social media platforms for user generated content (UGC) use different default video display aspect ratios, with some using vertical video and some using horizontal video. The display rectangles SEI message targets repurposing a coded video for a variety of video streaming platforms and devices that use different default display aspect ratios, using cropping and filling.
A software merge request aligned with the DR SEI message design in JVET-AP2032 has been provided at the following link: https://vcgit.hhi.fraunhofer.de/jvet-tuc/VVCSoftware_VTM/-/merge_requests/71
In addition to syntax parsing, this software performs the pixel processing to output a selected target picture when filling is not used and for a subset of the defined filling methods. The software will be updated to support all of the defined filling methods in the near future.
It is proposed to move the DR SEI message from the VSEI TuC to the VSEI version 5 working draft.
As per criteria:
- Maturity: clear
- Usage scenario: clear
- Showcase: available in JVET-AL0141
- Software: available for write/parse and generation of output (one method of filling – gradient – not supported)
- Added value in SEI universe: purpose cannot be achieved by conformance cropping
- Added value compared to systems level solutions: n/a
- Competition with other developments: n/a