Kourkchi, Hossein (2018) MAP Joint Source-Channel Arithmetic Decoding for Compressed Video. PhD thesis, Concordia University.
Preview |
Text (application/pdf)
6MBKourkchi_PhD_F2018.pdf - Accepted Version |
Abstract
In order to have robust video transmission over error prone telecommunication channels several mechanisms are introduced. These mechanisms try to detect, correct or conceal the errors in the received video stream.
In this thesis, the performance of the video codec is improved in terms of error rates without increasing overhead in terms of data bit rate. This is done by exploiting the residual syntactic/semantic redundancy inside compressed video along with optimizing the configuration of the state-of-the art entropy coding, i.e., binary arithmetic coding, and optimizing the quantization of the channel output. The thesis is divided into four phases.
In the first phase, a breadth-first suboptimal sequential maximum a posteriori (MAP) decoder is employed for joint source-channel arithmetic decoding of H.264 symbols. The proposed decoder uses not only the intentional redundancy inserted via a forbidden symbol (FS) but also exploits residual redundancy by a syntax checker. In contrast to previous methods this is done as each channel bit is decoded. Simulations using intra prediction modes show improvements in error rates, e.g., syntax element error rate reduction by an order of magnitude for channel SNR of 7.33dB. The cost of this improvement is more computational complexity spent on the syntax checking.
In the second phase, the configuration of the FS in the symbol set is studied. The delay probability function, i.e., the probability of the number of bits required to detect an error, is calculated for various FS configurations. The probability of missed error detection is calculated as a figure of merit for optimizing the FS configuration. The simulation results show the effectiveness of the proposed figure of merit, and support the FS configuration in which the FS lies entirely between the other information carrying symbols to be the best.
In the third phase, a new method for estimating the a priori probability of particular syntax elements is proposed. This estimation is based on the interdependency among the syntax elements that were previously decoded. This estimation is categorized as either reliable or unreliable. The decoder uses this prior information when they are reliable, otherwise the MAP decoder considers that the syntax elements are equiprobable and in turn uses maximum likelihood (ML) decoding. The reliability detection is carried out using a threshold on the local entropy of syntax elements in the neighboring macroblocks.
In the last phase, a new measure to assess performance of the channel quantizer is proposed. This measure is based on the statistics of the rank of true candidate among the sorted list of candidates in the MAP decoder. Simulation results shows that a quantizer designed based on the proposed measure is superior to the quantizers designed based on maximum mutual information and minimum mean square error.
| Divisions: | Concordia University > Gina Cody School of Engineering and Computer Science > Electrical and Computer Engineering |
|---|---|
| Item Type: | Thesis (PhD) |
| Authors: | Kourkchi, Hossein |
| Institution: | Concordia University |
| Degree Name: | Ph. D. |
| Program: | Electrical and Computer Engineering |
| Date: | May 2018 |
| Thesis Supervisor(s): | Ahmad, M. Omair and Lynch, William E. |
| ID Code: | 984254 |
| Deposited By: | HOSSEIN KOURKCHI |
| Deposited On: | 31 Oct 2018 17:34 |
| Last Modified: | 02 Apr 2019 15:44 |
References:
[1] Cisco, "Cisco Visual Networking Index: Forecast and Methodology, 2016–2021," 15 September 2017. [Online]. Available: https://www.cisco.com/c/en/us/ solutions/ collateral/service-provider/visual-networking-index-vni/complete-white-paper-c11-481360.html#_Toc484813971.[2] J. Joskowicz and R. Sotelo, "A model for video quality assessment considering packet loss for broadcast digital television coded in H.264," International journal of digital multimedia broadcasting, vol. 2014, no. 242531, pp. 1-11, 2014.
[3] I. E. Richardson, The H.264 advanced video compression standard, John Wiley, 2010.
[4] Y. Wang, J. Ostermann and Y.-Q. Zhang, Video processing and communications, Prentice Hall, 2001.
[5] G. J. Sullivan, J. Ohm, W. J. Han and T. Wiegand, "Overview of the high efficiency video coding (HEVC) standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649-1668, 2012.
[6] I. H. Witten, R. M. Neal and J. G. Cleary, "Arithmetic coding for data compression," Communications of the ACM, vol. 30, pp. 520-540, June 1987.
[7] T. M. Cover and J. A. Thomas, Elements of information theory, Hoboken, N.J. : Wiley-Interscience, 2nd ed, 2006.
[8] D. Levine, W. E. Lynch and T. Le-Ngoc, "Observations on error detection in H.264," in proceedings 50th Midwest Symposium on Circuits and Systems, Montreal, Canada, 5-8 Aug. 2007.
[9] D. Levin, Error Resilient Transmission of H.264 Compressed Video Using CABAC Entropy Coding, Montreal: Concordia University, Thesis, 2007.
[10] J. Chou and K. Ramchandran, "Arithmetic coding-based continuous error detection for efficient ARQ-based image transmission," IEEE Journal on Selected Areas in Communications, vol. 18, no. 6, pp. 861-867, June 2000.
[11] D. Xuewen, Y. Zhaoxuan, W. Jiapeng, C. Yang and Y. Yuan, "Detection and localization of transmission error in MPEG-4 video," in International Conference on Wireless Communications, Networking and Mobile Computing, Vancouver, Canada, Sept. 2006.
[12] P. Bansal, M. R. Narendran and M. N. K. Murali, "Improved error detection and localization techniques for MPEG-4 video," in Proceedings international conference on image processing, 2002.
[13] W. Kwok and H. Sun, "Multi-directional interpolation for spatial error concealment," IEEE Transactions on Consumer Electronics, vol. 39, no. 3, pp. 455-460, June 1993.
[14] W. E. Ryan and S. Lin, Channel codes : classical and modern, Cambridge, UK; New York: Cambridge University Press, 2009.
[15] H. Wang, L. Kondi, A. Luthra and S. Ci, 4G wireless video communications, Chichester, West Sussex, U.K.: Wiley, 2009.
[16] ITU-T, "H.264 : Advanced video coding for generic audiovisual services," Telecommunication standardization sector of ITU, April 2017.
[17] B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, Y.-K. Wang and T. Wiegand, "High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Last Call)," 12th Meeting: Geneva, CH, 14–23 Jan. 2013.
[18] T. Wiegand, G. J. Sullivan, G. Bjøntegaard and A. Luthra, "Overview of the H.264/AVC video coding standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560-576, 2003.
[19] M. Pourazad, C. Doutre, M. Azimi and P. Nasiopoulos, "HEVC: the new gold standard for video compression: how does HEVC compare with H.264/AVC?," Consumer Electronics Magazine, IEEE, vol. 1, no. 3, pp. 36-46, July 2012.
[20] P. Decker, "An adaptive type-II hybrid ARQ/FEC protocol suitable for GSM," in in Proceedings of IEEE vehicular technology conference (VTC), Stockholm, 1994.
[21] D. W. Redmill, D. R. Bull, J. T. Chung-How and N. G. Kingsbury, "Error-resilient image and video coding for wireless communication systems," Electronics and Communication Engineering Journal, vol. 10, no. 4, pp. 181-190, Aug. 1998.
[22] J. R. Casas and L. Torres, "Coding of details in very low bit-rate video systems," IEEE Transactions on circuits and systems for video technology, vol. 4, no. 3, pp. 317-327, June 1994.
[23] S. Ben Jamaa, M. Kieffer and P. Duhamel, "Improved sequential MAP estimation of CABAC encoded data with objective adjustment of the complexity/efficiency tradeoff," IEEE Transactions on Communications, vol. 57, no. 7, pp. 2014-2023, July 2009.
[24] G. Sabeva, S. Ben Jamaa, S. Kieffer and P. Duhamel, "Robust decoding of H.264 encoded video transmitted over wireless channels," in proceedings of IEEE 8th Workshop on Multimedia Signal Processing, Victoria, Canada, 2006.
[25] P. Duhamel and M. Kieffer, Joint source-channel decoding, a cross-layer perspective with applications in video broadcasting, Academic Press, 2010.
[26] F. Caron and S. Coulombe, "A maximum likelihood approach to video error correction applied to H.264 decoding," in proceedings 6th International Conference on Next Generation Mobile Applications, Services and Technologies (NGMAST), 12-14 Sep. 2012.
[27] M. Grangetto, P. Cosman and G. Olmo, "Joint source/channel coding and MAP decoding of arithmetic codes," IEEE Transactions on Communications, vol. 53, no. 6, pp. 1007-1016, June 2005.
[28] M. Grangetto, B. Scanavino and G. Olmo, "Joint source-channel iterative decoding of codes," in proceeding IEEE International Conference on Communications, 20-24 June 2004.
[29] M. Grangetto, B. Scanavino, G. Olmo and S. Benedetto, "Iterative decoding of serially concatenated arithmetic and channel codes with JPEG 2000 applications," IEEE Transactions on Image Processing, vol. 16, no. 6, pp. 1557-1567, June 2007.
[30] D. Levine, W. E. Lynch and T. Le-Ngoc, "Iterative joint source-channel decoding of H.264 compressed video," in proceeding IEEE International Symposium on Circuits and Systems, New Orleans, LA, USA, May 2007.
[31] N. Q. Nguyen, W. E. Lynch and T. Le-Ngoc., "Iterative Joint Source-Channel Decoding for H.264 video transmission using virtual checking method at source decoder," in proceeding 23rd Canadian Conference on Electrical and Computer Engineering, Calgary, AB, May 2010.
[32] C. Boyd, J. Cleary, I. Irvine, I. Rinsma-Melchert and I. Witten, "Integrating error detection into arithmetic coding," IEEE Transaction on Communications, vol. 45, no. 1, pp. 1-3, January 1997.
[33] T. Guionnet and C. Guillemot, "Soft decoding and synchronization of arithmetic codes: application to image transmission over noisy channels," IEEE Transactions on Image Processing, vol. 12, no. 12, pp. 1599-1609, Dec. 2003.
[34] S. J. Johnson, Iterative error correction : turbo, low-density parity-check and repeat-accumulate codes, Cambridge, UK ; New York: Cambridge University Press, 2010.
[35] M. R. Soleymani and U. V. Yingzi Gao, Turbo coding for satellite and wireless communications, Boston: Kluwer Academic Publishers, 2002.
[36] D. Bi, M. W. Hoffman and K. Sayood, Joint Source Channel Coding Using Arithmetic Codes, Morgan & Claypool, 2010.
[37] M. Grangetto and P. Cosman, "MAP decoding of arithmetic codes with a forbidden symbol," in proceedings Advanced Concepts for Intelligent Vision Systems, Ghent, Belgium, Sep., 2002.
[38] J. B. Anderson and S. Mohan, Source and Channel Coding: an algorithmic aproach, Norwell, MA: Kluwer Academic Publisher, 1991.
[39] A. Papoulis and S. U. Pillai, Probability, random variables, and stochastic processes, Boston: McGraw-Hill, 2002.
[40] W. Xuan, L. Jianhua, Y. Chengwei and C. Changwen, "Improved error detection ability of binary arithmetic codes," in Proceedings of IEEE International Symposium on Microwave, Antenna, Propagation and EMC Technologies for Wireless Communications, August 2005.
[41] T. Spiteri and V. Buttigieg, "Arithmetic coding for joint source-channel coding," in Proceedings of International Conference on Signal Processing and Multimedia Applications, Athens, Greece, 2010.
[42] S. Ben Jamaa, C. Weidmann and M. Kieffer, "Analytical tools for optimizing the error correction performance of arithmetic codes," IEEE Transactions on in Communications, vol. 56, no. 9, pp. 1458-1468, September 2008.
[43] A. H. Murad and T. E. Fuja, "Exploiting the residual redundancy in motion estimation vectors to improve the quality of compressed video transmitted over noisy channels," in Proceedings 1998 International Conference on Image Processing, Chicago, IL, 1998.
[44] F. Caron and S. Coulombe, "Video error correction using soft-output and hard-output maximum likelihood decoding applied to an H.264 baseline profile," IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 25, pp. 1161-1174, July 2015.
[45] J. G. Proakis, Digital communications, New York, NY: McGraw Hill, 2001.
[46] A. K. Jain, "Fundamentals of digital image processing," 1989.
[47] A. D. Liveris and C. N. Georghiades, "On quantization of low-density parity-check coded channel measurements," in Proceeding global telecommunications conference, 2003.
[48] J. Singh, O. Dabeer and U. Madhow, "Capacity of the discrete-time AWGN channel under output quantization," in IEEE International symposium on information theory, Toronto, ON, 2008.
[49] J. L. Massey, "Coding and modulation in digital communications," in Procedding International Zurich Seminar Digital Communication, Zurich, Switzerland, 1974.
[50] L. N. Lee, "On optimal soft-decision demodulation," IEEE transaction on Information Theory, vol. 22, no. 4, pp. 437-444, 1976.
[51] ITU-T, "Recommendation ITU-T H.265: High efficiency video coding," Telecommunication standardization sector of ITU, December 2016.
[52] V. Sze, M. Budagavi and G. J. Sullivan, High efficiency video coding (HEVC) algorithms and architectures, New York: Springer, 2014.
[53] A. Tamhankar and K. R. Rao, "An overview of H.264/MPEG-4 part 10," in proceeding 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications, Zagreb, Croatia, 2003.
[54] A. Bovik, The essential guide to video processing, Academic Press, 2009, pp. 246-248.
[55] S. Milani, "Fast H.264/AVC FRExt intra coding using belief propagation," IEEE Transactions on Image Processing, vol. 20, no. 1, pp. 121-131, Jan. 2011.
[56] http://trace.eas.asu.edu/yuv/index.html.
[57] D. Marpe, H. Schwarz and T. Wiegand, "Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard," IEEE Transactions on Circuits and Systems for Video Technology, vol. 7, no. 13, pp. 620-636, July 2003.
[58] C. E. Shannon, "A mathematical theory of communication," Bell SystemTechnical Journal, vol. 27, p. 279–423, 1948.
[59] H. Kourkchi, W. E. Lynch and M. O. Ahmad, "A measure for the missed error detection probability for optimizing the forbidden symbol configuration in joint source-channel arithmetic codes," in proceeding IEEE International Symposium on Circuits and Systems, Montreal, QC, May 2016.
[60] N. Phamdo and N. Farvardin, "Optimal detection of discrete Markov sources over discrete memoryless channels—Applications to combined-source channel coding," IEEE Transaction in Information Theory, vol. 40, p. 186–193, 1994.
[61] D. J. Miller and M. Park, "A sequence-based approximate mmse decoder for source coding over noisy channels using discrete hidden markov models," IEEE Transactions on Communications, vol. 46, no. 2, pp. 222-231, Feb 1998.
[62] H. Kourkchi, W. E. Lynch and M. O. Ahmad, "A joint source channel arithmetic MAP decoder using probabilistic relations among intra modes in predictive video compression," in proceeding IEEE International Conference on Acoustics, Speech, and Signal Processing, Calgary, AB, April 2018.
[63] "Fraunhofer Heinrich Hertz Institute," [Online]. Available: http://iphome.hhi.de/ suehring/tml/.
[64] H. Kourkchi, W. E. Lynch and M. O. Ahmad, "Improving MAP arithmetic decoding of H.264 intra modes using residual redundancy," in Proceedings of International Conference on Digital Image Processing, Los Angeles, USA, April 2015.
[65] Q. Lin and K. W. Wong, "Improving the error correction capability of arithmetic coding by forecasting forbidden symbols," in IEEE International Symposium on Circuits and Systems, Beijing, 2013.
[66] T. Guionnet and C. Guillemot, "Soft and joint source-channel decoding of quasi-arithmetic codes," EURASIP Journal on Applied Signal Processing, vol. 2004, pp. 393-411, March 2004.
[67] F. Lahouti and A. K. Khandani, "Efficient source decoding over memoryless noisy channels using higher order Markov models," IEEE Transactions on Information Theory, vol. 50, no. 9, pp. 2103-2118, September 2004.
[68] L. Z. B. Luo, "Fast intra-prediction mode selection method for h.264 video coding," in International conference on intelligent system design and engineering application, Changsha, 2010.
[69] J. Wang, T. Courtade, H. Shankar and R. D. Wesel, "Soft information for LDPC decoding in flash: mutual-information optimized quantization," in IEEE Global Telecommunications Conference, Houston, TX, USA, 2011.
[70] G. Dong, N. Xie and T. Zhang, "On the use of softdecision errorcorrection codes in NAND flash memory," IEEE Transaction in Circuits and Systems, vol. 5, no. 2, pp. 429-439, Feb. 2011.
[71] T. Kobayashi, S. Kametan, K. Shimizu, K. Onohara, H. Tagami and T. Mizuochi, "Soft decision LSI operating at 32 Gsample/s for LDPC FEC-based optical transmission systems," in Conference on Optical Fiber Fommunication - Incudes Post Deadline Papers, San Diego, CA, Mar. 2009.
[72] X. Ma, X. Zhang, H. Yu and A. Kavcic, "Optimal quantization for soft-decision decoding revisited," in Proc. Int. Symp. Inform. Theory Appl., Xian, China, October 2002.
[73] B. M. Kurkoski and H. Yagi, "Quantization of binary-input discrete memoryless channels," IEEE transactions on information theory, vol. 60, no. 8, pp. 4544-4552, August 2014.
[74] S. Lloyd, "Least squares quantization in PCM," IEEE Transaction on Information Theory, vol. 28, pp. 129-137, 1982.
[75] J. Max, "Quantizing for minimum distortion," IEEE Transaction on Information Theory, vol. 6, pp. 7-12, 1960.
[76] J. D. Hoffman, Numerical methods for engineers and scientists, 2 ed., New York: McGraw-Hill, 1992.
[77] H. Kourkchi, W. E. Lynch and M. O. Ahmad, "Arithmetic decoding with limited-precision information," To be submitted for publication in IET Image Processing.
[78] R. E. Miller, Optimization: foundations and applications, New York: John Wiley and Sons, 2000.
[79] A. Gilat and V. Subramaniam, Numerical methods for engineers and scientists: an introduction with applications using MATLAB, John wiley and sons, 2011.
[80] C. De Boor, A practical guide to splines, New York: Springer-Verlag, 2001.
[81] Mathworks, 13 July 2017. [Online]. Available: https://www.mathworks. com/help/ curvefit/csaps.html. [Accessed 13 July 2017].
[82] J. Dong, "Estimation of bit error rate of any digital communication system," Telecom Bretagne, Universite de Bretagne Occidentale, 2013.
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.
Repository Staff Only: item control page
Download Statistics
Download Statistics