Pavel Ditenbir

Encoding is the process of converting information to a new form that it requires much less memory space, saves the same amount of information while being decoded. Read more.

Encoding Basis


https://www.youtube.com/watch?v=Gr6U4ypFITE Introduction
At [ViCue Soft](/) we have a huge amount of expertise in video encoding which we woul

3 Cases from a Video Expert: Encoding Basis

Denis Fedorov


Welcome to a new article about Versatile Video Coding! Previously, we explained how [Affine Merge Mode](/blog/titles/Affine_Motion/) works and now we’ll look at Subblock-based Temporal Motion Vector Prediction (SbTMVP). SbTMVP is a type of a merge mode too. Both these methods are connected in VVC by using the same merge context. For demonstration we will use [VQ Analyzer](/vq-analyzer/) — a bitstream analysis tool developed by [ViCueSoft](/).

![Figure 1. VQ Analyzer. Prediction mode with SbTMVP prediction blocks](/assets/blog/img/subblock-based/prediction_mode.png)Figure 1. VQ Analyzer. Prediction mode with SbTMVP prediction blocks

The main idea of SbTMVP algorithm is to use motion information from the collocated picture. It is similar to TMVP in HEVC, but it works for CU-subblocks instead of whole CU. Motion vectors from the collocated picture are scaled.

![Figure 2. Deriving subblocks motion vectors in SbTMVP by applying shift from A1 neighbor and scaling subblocks motion vectors](/assets/blog/img/subblock-based/subblocks_motion_vector.png)Figure 2. Deriving subblocks motion vectors in SbTMVP by applying shift from A1 neighbor and scaling subblocks motion vectors

SbTMVP algorithm is demonstrated in Figure 2. Its main steps are:

1. Divide CU onto small subblocks, subblock size is fixed to 8x8 pixels. As in Affine Merge Mode, SbTMVP is applicable for coding units which are larger then 8x8 pixels.

2. Derive motion shift on the collocated picture:

- If A1 neighbor has a motion vector that uses the collocated picture as its reference picture — use it
- Otherwise, motion shift is set to zero MV (0,0)

3. Apply derived motion shift in the collocated picture. Shift is added to the current block’s coordinates.

4. Get initial vector from the center of CU. it will be used as default for subblocks with unavailable motion information.

5. Identify subblocks motion information (from the center of subblocks). If any subblock is unavailable, use default MV.

6. Derive subblocks motion vectors and reference indices by applying scaling for corresponding subblocks. Scaling is done by using POC differences tb and td, as shown in Figure 3. Td is difference between collocated picture and reference, tb is difference between current picture and reference.

![Figure 3. Illustration of motion vector scaling for TMVP](/assets/blog/img/subblock-based/vector_scaling.png)Figure 3. Illustration of motion vector scaling for TMVP

When SbTMVP is enabled, the list of merge candidates consists of SbTMVP predictor and [Affine Merge](/blog/titles/Affine_Motion/) candidates, as shown in Figure 4. SbTMVP candidate is added to the first position of the list. The SbTVMP mode is enabled by a sequence parameter set (SPS) flag.

![Figure 4. VQ Analyzer. Detail view of SbTMVP prediction unit](/assets/blog/img/subblock-based/detail_view_unit.png)Figure 4. VQ Analyzer. Detail view of SbTMVP prediction unit

This is all for today. In this article, we demonstrated how [VQ Analyzer](/vq-analyzer/) from [ViCueSoft](/) can visualize and display details for Subblock-based Temporal Motion Vector Prediction in Versatile Video Codec. If you have any questions or comments, please write to us directly at [info@vicuesoft.com](mailto:info@vicuesoft.com).





Welcome to a new article about Versatile Video Coding! Previously, we explained how...

Subblock-based Temporal Motion Vector Prediction (SbTMVP) in VVC


Welcome to a new article about Versatile Video Coding! Previously, we explained how [Affine Merge Mode](/blog/titles/Affine_Motion/) works and

#Video:

3 Cases from a Video Expert: Encoding Basis

Subblock-based Temporal Motion Vector Prediction (SbTMVP) in VVC