Chapter 10
Advanced 3D Video Streaming Applications
Guan-Ming Su, Yu-Chi Lai,
Andres Kwasinski,
Haohong Wang,
Yu-Chi Lai
National Taiwan University of Science and Technology, Taiwan
Search for more papers by this authorAndres Kwasinski
Rochester Institute of Technology, New York, USA
Search for more papers by this authorBook Author(s):Guan-Ming Su, Yu-Chi Lai,
Andres Kwasinski,
Haohong Wang,
Yu-Chi Lai
National Taiwan University of Science and Technology, Taiwan
Search for more papers by this authorAndres Kwasinski
Rochester Institute of Technology, New York, USA
Search for more papers by this authorSummary
Streaming 3D video over communication networks for real-time application has many challenges. One of these is how to utilize the current limited network resources to achieve the best perceived 3D video quality. For the best received quality, the streaming applications need to dynamically perform rate control to adjust the encoding rate at the encoder side to fit in the current network status and maintain the playback smoothness at the decoder side. However, different coding tools and modes can be selected to meet the same target bit rate but result in different perceived quality. It is desired to have a fast selection method for near-optimal solutions to reduce the computation complexity at the encoder side. This chapter addresses both the rate control and the mode decision issue in the 3D video streaming applications.
Controlled Vocabulary Terms
codecs; communication networks; encoding; Streaming media; three-dimensional displays
References
- ISO-IEC/JTC1/SC29/WG11/N0400. Test model 5, April 1993. Document AVC-491b, Version 2.
- H.-J. Lee, T. Chiang, and Y.-Q. Zhang, “Scalable rate control for MPEG-4 video”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, no. 6, pp. 878–894, June 2000.
- Z. Li, F. Pan, K. P. Lim, G. Feng, X. Lin, and S. Rahardja, “Adaptive basic unit layer rate control for JVT”, JVT-G012, Joint Video Team of ISO/IEC MPEG & ITU-T VCEG 7th Meeting: March 2003.
- L. Wang and A. Vincent, “Bit allocation and constraints for joint coding of multiple video programs”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, no. 6, September 1999, pp. 949–959.
- G.-M. Su and M. Wu, “Efficient bandwidth resource allocation low-delay multiuser video streaming”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 15, no. 9, pp. 1124–1137, September 2005.
- J.-R. Ohm, “Advances in Scalable Video Coding”, Proceedings of the IEEE, vol. 93, no. 1, January 2005. pp. 42–56.
-
T. Yan, P. An, L. Shen, Q. Zhang, and Z. Zhang, “ Rate control algorithm for multi-view video coding based on correlation analysis”, Symposium on Photonics and Optoelectronics, 2009.
10.1109/SOPO.2009.5230177 Google Scholar
- G.-M. Su, Z. Han, M. Wu, and K. J. R. Liu, “A scalable multiuser framework for video over OFDM networks: fairness and efficiency”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 16, no. 10, October 2006, pp. 1217–1231.
- J. H. Kim, J. Garcia, and A. Ortega, “Dependent bit allocation in multi-view video coding”, IEEE International Conference on Image Processing, vol. 2, pp. 293–296, 2005.
- Y. Morvan, D. Farin, and P. H. N. de With, “Joint depth/texture bit allocation for multi-view video compression”, in Proc. 26th PCS, November 2007, pp. 265–268.
- Y. Liu, Q. Huang, S. Ma, D. Zhao, and W. Gao, “Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model”, Signal Process.: Image Commun., vol. 24, no. 8, pp. 666–681, September 2009.
- H. Yuan, Y. Chang, J. Huo, F. Yang, and Z. Lu, “Model-Based Joint Bit Allocation Between Texture Videos and Depth Maps for 3D Video Coding”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 21, no. 4, pp. 485–497, April 2011.
- Y. Liu, Q. Huang, S. Ma, D. Zhao, W. Gao, S. Ci, and H. Tang, “A novel rate control technique for multi-view video plus depth based 3D video coding”, IEEE Trans. on Broadcasting, vol. 57, no. 2, June 2011, pp. 562–571.
- G. Cheung, V. Velisavljevic, and A. Ortega, “On dependent bit allocation for multi-view image coding with depth-image-based rendering”, IEEE Trans. on Image Processing, vol. 20, no. 11, November 2011, pp. 3179–3194.
- J.-G. Lou, H. Cai, and J. Li, “Interactive multi-view video delivery based on IP multicast”, Advances in Multimedia, vol. 2007, article ID 97535.
- E. Kurutepe, M. R. Civanlar, and A. M. Tekalp, “Client-driven selective streaming of multi-view video for interactive 3DTV”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 17, no. 11, November 2007, pp. 1558–1565.
- M. Karczewicz and R. Kurceren, “The SP- and SI-frames design for H.264/AVC”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 637–644, Jul. 2003.
- K.-Ki. Lai, Y.-L. Chan, and W.-C. Siu, “Quantized transform-domain motion estimation for SP-frame coding in viewpoint switching of multi-view video”, IEEE Trans. on Circuits and Systems for Video Technology, vol. 20, no. 3, March 2010, pp. 365–381.
- G. Cheung, A. Ortega, and N.-M. Cheung, “Interactive streaming of stored multi-view video using redundant frame structures”, IEEE Trans. on Image Processing, vol. 20, no. 3, March 2011, pp. 744–761.
-
Z. Pan, Y. Ikuta, M. Bandai, T. Watanabe, “ User dependent scheme for multi-view video transmission”, IEEE International Conference on Communications, 2011.
10.1109/icc.2011.5963404 Google Scholar
- Z. Liu, G. Cheung, V. Velisavljević, E. Ekmekcioglu, and Y. Yusheng Ji, “Joint source channel coding for WWAN multi-view video multicast with cooperative peer-to-peer repair”, Packet Video Workshop, 2010, pp. 110–117.
- J. Kim, K. Choi, H. Lee, and J. W. Kim, “Multi-view 3D video transport using application layer multicast with view switching delay constraints”, 3DTV Conference, 2007, pp. 1–4.
- E. Kurutepe and T. Sikora, “Feasibility of multi-view video streaming over P2P networks”, 3DTV Conference, 2008, pp. 157–160.
- E. Kurutepe and T. Sikora, “Multi-view video streaming over P2P networks with low start-up delay”, IEEE International Conference on Image Processing 2008, pp. 3088–3091.
- Z. Chen, L. Sun, and S. Yang, “Overcoming view switching dynamic in multi-view video streaming over P2P network”, 3DTV Conference, 2010, p. 1–4.
- S. Milani, M. Gaggio, and G. Calvagno, “ 3DTV streaming over peer-to-peer networks using FEC-based noncooperative multiple description”, IEEE Symposium on Computers and Communications, 2011, pp. 13–18.
- Y. Ding and J. Liu, “ Efficient stereo segment scheduling in peer-to-peer 3D/multi-view video streaming”, IEEE International Conference on Peer-to-Peer Computing 2011. pp. 182–191.
- G. B. Akar, A. M. Tekalp, C. Fehn, and M. R. Civanlar, “Transport Methods in 3DTV – A Survey”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1622–1630, November 2007.
- U. H. Reimers, “DVB – The Family of International Standards for Digital Video Broadcasting”, Proceedings of the IEEE, vol. 94, no. 1, pp. 173–182, January 2006.
- G. Faria, J. A. Henriksson, E. Stare, and P. Talmola, “DVB-H: Digital Broadcast Services to Handheld Devices”, Proceedings of the IEEE, vol. 94, no. 1, pp. 194–209, January 2006.
- A. Aksay, M. Orgu z Bici, D. Bugdayci, A. Tikanmaki, A. Gotchev, and G. B. Akar, “A study on the effect of MPE-FEC for 3D video broadcasting over DVB-H”, in Proceedings of the 5th International ICST Mobile Multimedia Communications Conference (Mobimedia), 2009.
- E. Kohler, M. Handley, and S. Floyd, “Datagram Congestion Control Protocol (DCCP)”, IETF Request for Comments 4340 (RFC-4340).
- H. Wang, L. Kondi, A. Luthra, S. Ci. 4G Wireless Video Communications, John Wiley & Sons, 2009.
- D. V. S. X De Silva, E. Ekmekcioglu, O. Abdul-Hameed, W. A. C. Fernando, S. T. Worrall, and A. M. Kondoz, “Performance evaluation of 3D-TV transmission over WiMAX broadband access networks”, in Proc. 5th International Conference on Information and Automation for Sustainability (ICIAFs), pp. 298–303, 17–19 December 2010.
- G.-M. Su, Z. Han, M. Wu, and K. J. R. Liu “A Scalable Multiuser Framework for Video over OFDM Networks: Fairness and Efficiency”. IEEE Transactions on Circuits and Systems for Video Technology, 2006; 16(10): 1217–1231.
- A. K. Al-Tamimi, C. So-In, and R. Jain. “Modeling and resource allocation for mobile video over WiMAX broadband wireless networks”. IEEE Journal on Selected Area in Communications, 2010; vol. 28 no. 3, pp. 354–365.
- H. Luo, S. Ci, S. Wu, J. Wu, H. Tang, “Quality-driven cross-layer optimized video delivery over LTE”. IEEE Communications Magazine, vol. 48 no. 2 pp. 102–109, 2010.
- M. Alasti, B. Neekzad, J. Hui, R. Vannithamby, “Quality of service in WiMAX and LTE networks”, IEEE Communications Magazine, vol. 48 no. 5 pp. 104–111, 2010.
