User:AndreyAkifev/sandbox

Frame Rate Up-Conversion
Frame rate up-conversion is the process of increasing the temporal resolution of a video sequence by synthesizing one or more intermediate frames between two consecutive frames. A low frame rate causes aliasing, yields abrupt motion artifacts, and degrades the video quality. Consequently, the temporal resolution is an important factor affecting video quality. Algorithms for FRC are widely used in applications, including visual quality enhancement, video compression and slow-motion video generation.

Methods
Most FRC methods can be categorized into optical flow or kernel-based and pixel hallucination-based methods.

Flow-based FRC
Flow-based methods linearly combines predicted optical flows between two input frames to approximate flows from the target intermediate frame to the input frames. They also propose flow reversal (projection) for more accurate image warping. Moreover, there are algorithms that gives different weights of overlapped flow vectors depending on the object depth of the scene via a flow projection layer.

Pixel Hallucination-based FRC
Pixel Hallucination-based methods use deformable convolution to the center frame generator by replacing optical flows with offset vectors. There are algorithms that also interpolates middle frames with the help of deformable convolution in the feature domain. However, since these methods directly hallucinate pixels unlike the flow-based FRC methods, the predicted frames tend to be blurry when fast-moving objects are present.

Instruments

 * Adobe Premiere Pro - Adobe Premiere Pro is a commercial video editing software program that allows you to slow down your video using optical flow and time remapping effects to conventionally shot footage to create better looking and smoother slow motion.


 * Vegas Pro - Vegas Pro also is a commercial video editing software program. There is a method to make slow motion video too. To perform it you need to choose the motion magnitude in your video and percentages of playback speed.


 * AviSynth MSU Frame Rate Conversion Filter - The AviSynth MSU Frame Rate Conversion Filter is an open-source tool intended for video frame rate up-conversion. It increases the frame rate integer times. It allows, for example, to convert a video with 15 fps into a video with 30 fps.


 * Advanced Frame Rate Converter (AFRC) - Main advantage of AFRC algorithm is using of several quality enhancement techniques such as adaptive artifact masking, black stripe processing and occlusion tracking:
 * adaptive artifact masking technique allows to make artifacts less noticeable for eyes thus increasing the integral quality of processed video;
 * black stripe processing allows to avoid artifacts which are commonly appeared in interpolated frames in case of black stripe presented near frame edges;
 * occlusion tracking performs high quality restoration of interpolated frames near edges in case of presence of motion with direction to/from the frame edge.


 * Topaz Video Enhance AI - Topaz Video Enhance AI has the Chronos AI model uses deep learning to increase video frame rate without artifacts. This algorithm generates new frames that are often indistinguishable from frames captured in-camera.