Abstract not available in document
JVET-I0006 JVET AHG Report: 360° video conversion software development (AHG6) [Y. He, K. Choi, V. Zakharchenko]
The document summarizes activities on 360-degree video content conversion software development between the 8th and the 9th JVET meetings.
The 360Lib-5.0 software package integrated all adoptions about projection format and metrics calculation, including:
- For projection formats and frame packing:
- Update on Rotated Sphere Projection (RSP) (JVET-H0056);
- For software:
- Fix for bug ticket #56;
- Bug fix for the interpolation weight derivation;
360Lib-5.0 related release:
360Lib-5.0rc1 with support of HM-16.16 and JEM-7.0 was released on Nov. 1st, 2017;
360Lib-5.0 with support of HM-16.16 and JEM-7.0 was released on Nov. 10th, 2017;
The 360Lib software is developed using a Subversion repository located at:
https://jvet.hhi.fraunhofer.de/svn/svn_360Lib/
The released version of 360Lib-5.0 can be found at:
https://jvet.hhi.fraunhofer.de/svn/svn_360Lib/tags/360Lib-45.0/
360Lib-5.0 testing results can be found at:
ftp.ient.rwth-aachen.de/testresults/360Lib-45.0
360Lib bug tracker
https://hevc.hhi.fraunhofer.de/trac/jem/newticket?component=360Lib
The table below lists the HM-16.16 based coding performance with different projection formats according to 360o video CTC (JVET-H1030) compared to PERP coding.
HM-16.16-360Lib-5.0 testing (HM PERP coding as anchor)
Projection | E2E WS-PSNR for all sequences | E2E WS-PSNR for 8K sequences | E2E WS-PSNR for 6K sequences | E2E WS-PSNR for 4K sequences | ||||||||
Y | U | V | Y | U | V | Y | U | V | Y | U | V | |
CMP | −2.4% | −0.7% | −1.0% | −5.1% | −3.0% | −3.5% | 0.1% | 3.3% | 2.8% | 0.5% | −1.6% | −1.2% |
AEP | −4.0% | −3.1% | −3.2% | −4.7% | −3.4% | −3.4% | −2.9% | −2.0% | −2.2% | −4.3% | −4.6% | −4.7% |
COHP | −1.4% | 1.5% | 0.6% | −5.0% | −0.2% | −1.3% | 3.5% | 5.5% | 4.5% | −0.4% | −1.1% | −1.3% |
CISP | −3.3% | 1.1% | 0.2% | −7.5% | −1.3% | −2.7% | 2.4% | 6.2% | 5.7% | −1.8% | −1.8% | −2.1% |
EAP-SSP | −9.7% | −5.7% | −6.3% | −11.9% | −6.4% | −6.6% | −7.3% | −4.1% | −5.3% | −7.6% | −6.9% | −7.2% |
ACP | −9.9% | −5.7% | −6.1% | −12.5% | −6.3% | −6.5% | −7.7% | −4.7% | −5.3% | −6.7% | −6.2% | −6.2% |
RSP | −9.2% | −5.8% | −6.1% | −12.4% | −7.0% | −7.4% | −6.0% | −3.9% | −4.5% | −6.0% | −5.9% | −5.3% |
ECP | −9.0% | −5.4% | −6.0% | −12.3% | −6.7% | −7.2% | −4.5% | −2.4% | −3.6% | −7.8% | −7.6% | −7.3% |
EAC | −9.9% | −5.8% | −6.0% | −12.5% | −6.4% | −6.4% | −8.1% | −4.8% | −5.3% | −6.2% | −6.2% | −6.0% |
The next table below compares the JEM-7.0 PERP coding with HM-16.16 PERP coding.
JEM-PERP vs HM-PERP coding (HM PERP coding as anchor)
anchor: HM-PERP | SPSNR-NN (End to End) | WS-PSNR (End to End) | ||||
test: JEM-PERP | Y | U | V | Y | U | V |
Trolley | −15.0% | −30.9% | −32.7% | −14.9% | −30.8% | −32.8% |
GasLamp | −20.3% | −44.6% | −41.5% | −20.2% | −44.6% | −41.5% |
Skateboarding_in_lot | −24.4% | −33.0% | −42.9% | −24.4% | −33.0% | −42.9% |
Chairlift | −29.8% | −48.6% | −45.6% | −29.9% | −48.6% | −45.7% |
KiteFlite | −16.5% | −35.3% | −38.6% | −16.4% | −35.2% | −38.5% |
Harbor | −19.0% | −41.7% | −42.2% | −19.0% | −41.7% | −42.2% |
Balboa | −33.1% | −36.5% | −40.9% | −33.1% | −36.5% | −40.9% |
Broadway | −32.9% | −38.5% | −41.5% | −32.9% | −38.5% | −41.5% |
Landing2 | −24.1% | −24.5% | −21.8% | −24.2% | −24.6% | −21.8% |
BranCastle2 | −22.0% | −29.0% | −28.7% | −22.0% | −29.0% | −28.6% |
PoleVault | −17.7% | −19.0% | −20.4% | −17.8% | −19.0% | −20.6% |
AerialCity | −24.8% | −44.7% | −31.0% | −24.9% | −44.8% | −30.9% |
Overall | −23.3% | −35.5% | −35.7% | −23.3% | −35.5% | −35.7% |
8K | −20.8% | −39.0% | −40.6% | −20.8% | −39.0% | −40.6% |
6K | −28.0% | −32.1% | −33.2% | −28.0% | −32.1% | −33.2% |
4K | −21.3% | −31.9% | −25.7% | −21.3% | −31.9% | −25.7% |
The next table below lists the conversion only end-to-end WS-PSNR for different projection formats compared to that of PERP format.
Conversion only results (PERP format as anchor)
Projection format | E2E WS-PSNR | E2E WS-PSNR for 8K sequences | E2E WS-PSNR for 6K sequences | E2E WS-PSNR for 4K sequences | ||||||||
Y | U | V | Y | U | V | Y | U | V | Y | U | V | |
PERP | 45.90 | 56.59 | 56.63 | 45.60 | 58.22 | 57.81 | 46.41 | 56.94 | 57.36 | 45.77 | 50.97 | 51.63 |
CMP | 0.88 | 0.50 | 0.47 | 0.81 | 0.46 | 0.46 | 1.33 | 0.71 | 0.67 | 0.20 | 0.17 | 0.11 |
AEP | 0.77 | 0.40 | 0.39 | 0.70 | 0.33 | 0.33 | 0.83 | 0.44 | 0.46 | 0.88 | 0.52 | 0.45 |
COHP | 1.32 | 0.62 | 0.62 | 1.49 | 0.56 | 0.54 | 1.41 | 0.76 | 0.81 | 0.61 | 0.50 | 0.46 |
CISP | 2.10 | 0.79 | 0.76 | 2.25 | 0.63 | 0.60 | 2.14 | 0.94 | 0.92 | 1.58 | 1.00 | 0.92 |
SSP | 2.29 | 1.06 | 1.04 | 2.25 | 0.67 | 0.65 | 1.98 | 0.95 | 0.96 | 3.04 | 2.47 | 2.40 |
ACP | 2.69 | 1.05 | 1.02 | 2.83 | 0.86 | 0.85 | 2.57 | 1.29 | 1.27 | 2.50 | 1.13 | 1.03 |
RSP | 2.44 | 1.23 | 1.18 | 2.28 | 0.66 | 0.64 | 2.02 | 0.98 | 0.96 | 3.75 | 3.43 | 3.27 |
ECP | 2.62 | 1.06 | 1.03 | 2.68 | 0.83 | 0.79 | 2.61 | 1.23 | 1.23 | 2.42 | 1.44 | 1.34 |
EAC | 2.90 | 1.37 | 1.34 | 2.81 | 0.86 | 0.85 | 2.60 | 1.30 | 1.27 | 3.81 | 3.05 | 2.96 |
The AHG recommended to continue software development of the 360Lib software package.