Abstract: This project serves as a control mechanism for Video Frame Interpolation (VFI) networks specifically tailored for anime. By calculating the DistanceRatioMap, it adjusts the frame interpolation strategies for spatiotemporally nonlinear and linear regions, thereby preserving the original pace and integrity of the characters while avoiding distortions common in frame interpolation.
Set up the environment for the following repository
Coming soon.
Due to the limitations of the RIFE algorithm's performance, some distortion may occur in the background during compensation.
If you use FastFlowNet TRT, RIFE v4.22 Lite TRT, and implement the project with VapourSynth, real-time playback can be achieved on a reasonably powerful NVIDIA GPU, such as the RTX 3070.
Combining the strengths of both RIFE and GMFSS, it delivers outstanding results.