首页 关于本刊 编 委 会 期刊动态 作者中心 审者中心 读者中心 下载中心 联系我们 English
 自动化学报  2018, Vol. 44 Issue (9): 1626-1636 PDF

1. 四川大学电子信息学院图像信息研究所 成都 610065;
2. 中国人民武装警察部队警官学院 成都 610213

A New Video Compression Encoding Algorithm Combining Frame Rate Conversion With HEVC Standard
WU Qi-Da1, HE Xiao-Hai1, LIN Hong-Wei1, TAO Qing-Chuan1, WU Di2
1. Image Information Institute, College of Electronics and Information Engineering, Sichuan University, Chengdu 610065;
2. Officers College of PAP, Chengdu 610213
Manuscript received : March 7, 2017, accepted: August 2, 2017.
Foundation Item: Supported by National Natural Science Foundation of China (61471248), Science and Technology Project of Sichuan Province (2015JY0189), and 2014 Postgraduate Education Innovation Project of Sichuan Education Department (2014-Education-034)
Corresponding author. HE Xiao-Hai Ph. D., professor at the College of Electronics and Information Engineering, Sichuan University. His research interest covers image processing, pattern recognition, and image communication. Corresponding author of this paper.
Abstract: Compared to the video coding standard H.264, the bit rate of HEVC can be reduced nearly by 50% with the same quality of reconstructed video. So HEVC can greatly save the bandwidth used for transmission. Even so, the transmission of video is still subject to the bandwidth of some special network. In order to further enhance the performance of HEVC, the work of further enhancing the video compression ratio is a hot issue. This paper proposes a new algorithm for video coding that combines HEVC with the technique of frame rate conversion. First, on the encoding side, the paper puts forward an adaptive frame-skip scheme to reduce the original video frame rate, so that the requirement for transmitting data is reduced. Then, the low frame rate video is encoded. On the decoding side, the algorithm uses the information of motion vector and special pattern of block for encoded video frames, which are extracted from the HEVC transmission stream, to reconstruct the video. Moreover, this algorithm can estimate the motion vector of the missing frames. Finally, the algorithm reconstructs the video using the proposed method based on block cover bidirectional motion compensation interpolation. Experimental results confirm the effectiveness of the proposed algorithm.
Key words: Frame rate conversion     HEVC     adaptive frame-skip     block coverage     motion compensation interpolation

1 结合帧率变换与HEVC标准的新型视频压缩编码算法

1.1 编码端自适应抽帧方法

 $MSAD_i=\frac{\sum\limits_{i=0}^{m-1}\sum\limits_{j=0}^{n-1}|f_i(i, j)-f_{i-1}(i, j)|}{m\times n}$ (1)
 $R=\frac{|MSAD_{i+1}-MSAD_i|}{|MSAD_{i+2}-MSAD_{i+1}|}$ (2)

 图 1 自适应抽帧结果图 Figure 1 The result of adaptive frame skip
1.2 丢失帧运动估计

 图 2 HEVC中的运动估计 Figure 2 The motion estimation in HEVC

 $\overline{V}_x= \pm\frac{1}{2}V_x, \quad \overline{V}_y=\pm\frac{1}{2}V_y$ (3)
 \begin{align} F_t(x, y)=&\ \frac{1}{2}(F_{t-1}(x+\overline{V}_x, y+\overline{V}_y)\, + \\ &\ F_{t+1}(x-\overline{V}_x, y-\overline{V}_y)) \end{align} (4)

3 总结与展望

 1 Lee S H, Shin Y C, Yang S, Moon H H, Park R H. Adaptive motion-compensated interpolation for frame rate up-conversion. IEEE Transactions on Consumer Electronics, 2002, 48(3): 444-450. DOI:10.1109/TCE.2002.1037026 2 Hilman K, Park H W, Kim Y M. Using motion-compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences. IEEE Transactions on Circuits and Systems for Video Technology, 2000, 10(6): 869-877. DOI:10.1109/76.867925 3 Kim D, Park H. An efficient motion-compensated frame interpolation method using temporal information for high-resolution videos. Journal of Display Technology, 2015, 11(7): 580-588. DOI:10.1109/JDT.2015.2417313 4 Tsai T H, Shi A T, Huang K T. Accurate frame rate up-conversion for advanced visual quality. IEEE Transactions on Broadcasting, 2016, 62(2): 426-435. DOI:10.1109/TBC.2016.2550764 5 Choi B T, Lee S H, Ko S J. New frame rate up-conversion using bi-directional motion estimation. IEEE Transactions on Consumer Electronics, 2000, 46(3): 603-609. DOI:10.1109/30.883418 6 Choi B D, Han J W, Kim C S, Ko S J. Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation. IEEE Transactions on Circuits and Systems for Video Technology, 2007, 17(4): 407-416. DOI:10.1109/TCSVT.2007.893835 7 Kang S J, Cho K R, Kim Y H. Motion compensated frame rate up-conversion using extended bilateral motion estimation. IEEE Transactions on Consumer Electronics, 2007, 53(4): 1759-1767. DOI:10.1109/TCE.2007.4429281 8 Kang S J, Yoo S J, Kim Y H. Dual motion estimation for frame rate up-conversion. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(12): 1909-1914. DOI:10.1109/TCSVT.2010.2087832 9 Hu H P, Liu G Y. A novel method for frame rate up-conversion. In: Proceedings of the 2011 International Conference on Image Analysis and Signal Processing (IASP). Wuhan, China: IEEE, 2011. 6-9 10 Inseo H, Ho S J, Myung H S. A new motion compensated frame interpolation algorithm using adaptive motion estimation. Journal of the Institute of Electronics and Information Engineers, 2015, 52(6): 62-69. DOI:10.5573/ieie.2015.52.6.062 11 Xu C, Chen Y Q, Gao Z Y, Ye Y Z, Shan T. Frame rate up-conversion with true motion estimation and adaptive motion vector refinement. In: Proceedings of the 4th International Congress on Image and Signal Processing (CISP). Shanghai, China: IEEE, 2011. 353-356 12 Cao Y Z H, He X H, Teng Q Z, Wu W. Motion compensated frame rate up-conversion using soft-decision motion estimation and adaptive-weighted motion compensated interpolation. Journal of Computational Information Systems, 2013, 9(14): 5789-5797. 13 Kaviani H R, Shirani S. Frame rate upconversion using optical flow and patch-based reconstruction. IEEE Transactions on Circuits and Systems for Video Technology, 2016, 26(9): 1581-1594. DOI:10.1109/TCSVT.2015.2469120 14 Lee W H, Choi K, Ra J B. Frame rate up conversion based on variational image fusion. IEEE Transactions on Image Processing, 2014, 23(1): 399-412. DOI:10.1109/TIP.2013.2288139 15 Sun Yan-Yue, He Xiao-Hai, Song Hai-Ying, Chen Wei-Long. A block-matching image registration algorithm for video super-resolution reconstruction. Acta Automatica Sinica, 2011, 37(1): 37-43.( 孙琰玥, 何小海, 宋海英, 陈为龙. 一种用于视频超分辨率重建的块匹配图像配准方法. 自动化学报, 2011, 37(1): 37-43.) 16 Kim U S, Sunwoo M H. New frame rate up-conversion algorithms with low computational complexity. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(3): 384-393. DOI:10.1109/TCSVT.2013.2278142 17 Lu Zhi-Hong, Guo Dan, Wang Meng. Motion-compensated frame interpolation based on weighted motion estimation and vector segmentation. Acta Automatica Sinica, 2015, 41(5): 1034-1041.( 鲁志红, 郭丹, 汪萌. 基于加权运动估计和矢量分割的运动补偿内插算法. 自动化学报, 2015, 41(5): 1034-1041.) 18 Ma Ming-Lang, He Xiao-Hai, Teng Qi-Zhi, Chen Hong-Gang, Qing Lin-Bo. Fingerprint image compression algorithm via adaptive sparse transformation. Acta Automatica Sinica, 2016, 42(8): 1274-1284.( 马名浪, 何小海, 滕奇志, 陈洪刚, 卿粼波. 基于自适应稀疏变换的指纹图像压缩. 自动化学报, 2016, 42(8): 1274-1284.) 19 Hong B, Eom M, Choe Y. Scene change detection using edge direction based on intra prediction mode in H.264/AVC compression domain. In: Proceedings of the 2006 IEEE Region 10 Conference. Hong Kong, China: IEEE, 2006. 1-4 20 Yan C G, Zhang Y D, Xu J Z, Dai F, Zhang J, Dai Q H, Wu F. Efficient parallel framework for HEVC motion estimation on many-core processors. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(12): 2077-2089. DOI:10.1109/TCSVT.2014.2335852 21 Heithausen C, Vorwerk J H. Motion compensation with higher order motion models for HEVC. In: Proceedings of the 2015 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). South Brisbane, QLD, Australia: IEEE, 2015. 1438-1442 22 Lee S H, Kwon O, Park R H. Weighted-adaptive motion-compensated frame rate up-conversion. IEEE Transactions on Consumer Electronics, 2003, 49(3): 485-492. DOI:10.1109/TCE.2003.1233759 23 Song H B, Men A D, Shi G J. A method for halo artifact reduction in MEMC. In: Proceedings of the 2009 Digest of Technical Papers International Conference on Consumer Electronics. Las Vegas, NV, USA: IEEE, 2009. 1-2