3D Video over Networks

The transmission of 3D video over a communication channel adds to the challenges associated with source compression, those arising from the errors that inevitably would be introduced in the channel. This chapter discusses error resilience techniques. One approach to provide larger error resilience to an encoded 3D video bit stream is to modify the compression procedure or the resulting compressed bit stream to aid in the recovery from errors or to provide a level of embedded redundancy in the encoding of information. The chapter focuses on channel-induced errors and their effect on end-to-end distortion. It discusses techniques to reduce the sensitivity to errors, to recover from them, and to efficiently protect against them. The chapter discusses techniques that allow the decoder to conceal and limit the effects of these errors on the reconstructed video.

Controlled Vocabulary Terms

distortion; three-dimensional displays; video signal processing

References

W. A. Pearlman and A. Said, “ Digital Signal Compression, Principles and Practice”, Cambridge University Press, 2011.
10.1017/CBO9780511984655
Google Scholar
B. Kamolrat, W. A. C. Fernando, M. Mark, A. Condos, “Joint source and channel coding for 3D video with depth image – based rendering”, IEEE Transactions on Consumer Electronics, vol. 54, no. 2, pp. 887–894, May 2008.
10.1109/TCE.2008.4560175
Web of Science® Google Scholar
Y. Zhou, C. Hou, W. Xiang, and F. Wu, “Channel Distortion Modeling for Multi-View Video Transmission Over Packet-Switched Networks”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 11, pp. 1679–1692, November 2011.
10.1109/TCSVT.2011.2133390
Web of Science® Google Scholar
D. V. S. X. De Silva, W. A. C. Fernando, S. T. Worrall, “3D Video communication scheme for error prone environments based on motion vector sharing”, 3DTV-Conference: The True Vision – Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1–4, 7–9 June 2010.
Google Scholar
M. B. Dissanayake, D. V. S. X. De Silva, S. T. Worrall, W. A. C. Fernando, “Error resilience technique for multi-view coding using redundant disparity vectors”, 2010 IEEE International Conference on Multimedia and Expo (ICME), pp. 1712–1717, 19–23 July 2010.
Google Scholar
Y. Zhou, C. Hou, R. Pan, Z. Yuan, and L. Yang, “Distortion analysis and error concealment for multi-view video transmission”, in Proceedings of the IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1–5, 24–26 March 2010.
Google Scholar
X. Xiang, D. Zhao, Q. Wang, X. Ji, and W. Gao, “A Novel Error Concealment Method for Stereoscopic Video Coding”, in Proceedings of the IEEE International Conference on Image Processing (ICIP), vol. 5, pp. V-101-V-104, 16–19 September 2007.
Google Scholar
C. T. E. R. Hewage, S. Worrall, S. Dogan, and A. M. Kondoz, “Frame concealment algorithm for stereoscopic video using motion vector sharing”, in Proceedings of the IEEE International Conference on Multimedia and Expo, pp. 485–488, 23–26 June 2008.
Google Scholar
K. Song, T. Chung, Y. Oh, and C.-S. Kim, “Error concealment of multi-view video sequences using inter-view and intra-view correlations”, Journal of Visual Communication and Image Representation, vol. 20, no. 4, May 2009, pp. 281–292.
10.1016/j.jvcir.2009.02.002
Web of Science® Google Scholar
A. Serdar Tan, A. Aksay, C. Bilen, G. Bozdagi Akar, and E. Arikan, “Rate-distortion optimized layered stereoscopic video streaming with raptor codes”, Packet Video 2007, pp. 98–104, 12–13 November 2007.
Google Scholar
C. Bilen, A. Aksay, and G. Bozdagi Akar, “A multi-view video codec based on H.264”, in Proceedings of the IEEE Conference on Image Processing (ICIP), 8–11 October, Atlanta, USA, 2006.
Google Scholar
M. Luby, M. Watson, T. Gasiba, T. Stockhammer, and W. Xu, “Raptor codes for reliable download delivery in wireless broadcast systems”, in Proc. of IEEE CCNC, pp. 192–197, 8–10 January, 2006.
Google Scholar
L. Ozarov, “On a source coding problem with two channels and three receivers”, Bell Sys. Tech. Journal, vol. 59, no. 10, pp. 1909–1921, December 1980.
10.1002/j.1538-7305.1980.tb03344.x
Google Scholar
M. Alasti, K. Sayrafian-Pour, A. Ephremides, and N. Farvardin, “Multiple Description Coding in Networks with Congestion Problem”, IEEE Transaction on Information Theory, vol. 47, no. 1, pp. 891–902, March 2001.
10.1109/18.915641
Web of Science® Google Scholar
J. N. Laneman, E. Martinian, G. W. Wornell, and J. G. Apostolopoulos, “Source-Channel Diversity for Parallel Channels”, IEEE Transaction on Information Theory, vol. 51, no. 10 , pp. 3518–3539, October 2005.
10.1109/TIT.2005.855578
Web of Science® Google Scholar
V. K. Goyal, “Multiple description coding: compression meets the network”, IEEE Signal Processing Magazine, vol. 18, no. 5, pp. 74–93, September 2001.
10.1109/79.952806
Web of Science® Google Scholar
A. R. Reibman, H. Jafarkhani, M. T. Orchard, and Y. Wang, “Performance of Multiple Description Coders on a Real Channel”, in Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. 5, pp. 2415–2418, 1999.
Google Scholar
A. Norkin, A. Aksay, C. Bilen, G. Akar, A. Gotchev, and J. Astola, “Schemes for Multiple Description Coding of Stereoscopic Video”, in Multimedia Content Representation, Classification and Security, vol. 4105, pp. 730–737, Springer Berlin/Heidelberg, 2006.
Google Scholar
H. A. Karim, C. Hewage, S. Worrall, and A. Kondoz, “Scalable multiple description video coding for stereoscopic 3D”, IEEE Transactions on Consumer Electronics, vol. 54, no. 2, pp. 745–752, May 2008.
10.1109/TCE.2008.4560156
Web of Science® Google Scholar
C. T. E. R. Hewage, Z. Ahmad, S. T. Worrall, S. Dogan, W. A. C. Fernando, and A. Kondoz, “Unequal Error Protection for backward compatible 3-D video transmission over WiMAX”, in Proc. IEEE International Symposium on Circuits and Systems, ISCAS 2009., pp. 125–128, 24–27 May 2009.
Google Scholar
I.K. Sileh, K.M. Alajel, Wei Xiang, “Cooperative Relay Selection Based UEP Scheme for 3D Video Transmission over Rayleigh Fading Channel”, in Proceedings of the 2011 International Conference on Digital Image Computing Techniques and Applications (DICTA), pp. 689–693, 6–8 December 2011.
Google Scholar
T. M. Cover and A. A. El Gamal, “Capacity theorems for the relay channel”, IEEE Transactions on Information Theory, vol. 25, no. 9, pp. 572–584, September 1979.
10.1109/TIT.1979.1056084
Web of Science® Google Scholar
A. Sendonaris, E. Erkip, and B. Aazhang, “User cooperation diversity, part I: System description”, IEEE Transactions on Communications, vol. 51, no. 11, pp. 1927–1938, November 2003.
10.1109/TCOMM.2003.818096
Google Scholar
J. N. Laneman and G. W. Wornell, “Distributed space-time coded protocols for exploiting cooperative diversity in wireless networks”, IEEE Transactions on Information Theory, vol. 49, no. 10, pp. 2415– 2525, October 2003.
10.1109/TIT.2003.817829
Web of Science® Google Scholar
J.N. Laneman, D.N.C. Tse, and G.W. Wornell, “Cooperative diversity in wireless networks: Efficient protocols and outage behavior”, Transactions on Information Theory, vol. 50, no. 12, pp. 3062–3080, December 2004.
10.1109/TIT.2004.838089
Web of Science® Google Scholar
A. Kwasinski and K. J. R. Liu, “Source-Channel-Cooperation Tradeoffs for Adaptive Coded Communications”, IEEE Transactions on Wireless Communications, vol. 7, no. 9, pp. 3347–3358, September 2008.
10.1109/TWC.2008.060286
Web of Science® Google Scholar

Citing Literature

3D Visual Communications