Recent years, we have witnessed significant progress in the quality enhancement of compressed video by deep learning methods. In this paper, we propose an effective method for Video Quality Enhancement(VQE) task. Our method is realized via \textbf{A Parallel Network for Compressed Video Enhancement(PEN)}. To tackle optical flow estimates and complicated motion, PEN has two branches which are \textbf{Offset Deformable Fusion Network(ODFN)} and \textbf{Complex Motion Solution Network(CMSN)}.
During the alignment stage, existing methods typically estimate optical flow for temporal motion compensation. However, because the compressed video may be severely distorted as a result of various compression artifacts, the estimated optical flow is typically inaccurate and unreliable. Therefore in ODFN we use deformable convolution to align frames in a fast and efficient way.
At the same time, we adopt pyramidal processing and cascading refinement in CMSN which can address complex motions and large parallax problems in alignment. Furthermore, we use the target frame's neighbor Peak Quality frames(PQFs) as reference frames, which adjusts for video quality variations.
Extensive experiments show that our method has improved the average video quality by 0.7 decibel. / Thesis / Master of Applied Science (MASc) / The quality of video is improving as cameras improve, but the size of the video is also increasing. As a result, we will need to compress the video. Video compression, on the other hand, is always accompanied with a loss of video quality.
Deep learning approaches have made tremendous progress in improving the quality of compressed video in recent years.
In this paper, we propose an effective method PEN for Video Quality Enhancement(VQE) task by parallel processing of multiple frames.
Identifer | oai:union.ndltd.org:mcmaster.ca/oai:macsphere.mcmaster.ca:11375/26895 |
Date | January 2021 |
Creators | Hao, Wei |
Contributors | Chen, Jun, Electrical and Computer Engineering |
Source Sets | McMaster University |
Language | English |
Detected Language | English |
Type | Thesis |
Page generated in 0.0016 seconds