Distributed Source Coding

Zixiang Xiong,

Zixiang Xiong

Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, USA

Search for more papers by this author

Angelos D. Liveris,

Angelos D. Liveris

Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, USA

Search for more papers by this author

Yang Yang,

Yang Yang

Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, USA

Search for more papers by this author

Zixiang Xiong,

Zixiang Xiong

Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, USA

Search for more papers by this author

Angelos D. Liveris,

Angelos D. Liveris

Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, USA

Search for more papers by this author

Yang Yang,

Yang Yang

Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, USA

Search for more papers by this author

Book Editor(s):Simon Haykin,

Simon Haykin

Department of Electrical Engineering, McMaster University, Hamilton, Ontario, Canada

Search for more papers by this author

K. J. Ray Liu,

K. J. Ray Liu

Department of Electrical & Computer Engineering, University of Maryland, College Park, MD, USA

Search for more papers by this author

First published: 22 January 2010

https://doi.org/10.1002/9780470487068.ch19

Citations: 1

Summary

This chapter contains sections titled:

Introduction
Theoretical Background
Code Designs
Applications
Conclusions
References

REFERENCES

D. Slepian and J. Wolf, “Noiseless coding of correlated information sources,” IEEE Trans. Inform. Theory, vol. 19, pp. 471–480, July 1973.
10.1109/TIT.1973.1055037
Web of Science® Google Scholar
A. Wyner and J. Ziv, “The rate-distortion function for source coding with side information at the decoder,” IEEE Trans. Inform. Theory, vol. 22, pp. 1–10, Jan. 1976.
10.1109/TIT.1976.1055508
Web of Science® Google Scholar
T. Berger, “Multiterminal source coding,” in The Information Theory Approach to Communications, G. Longo (Ed.), New York: Springer-Verlag, 1977.
Google Scholar
S. Tung, “Multiterminal rate-distortion theory,” PhD dissertation, School of Electrical Engineering, Cornell University, Ithaca, NY, 1978.
Google Scholar
H. Yamamoto and K. Itoh, “Source coding theory for multiterminal communication systems with a remote source,” Trans. IECE Jpn., vol. E63, pp. 700–706, Oct. 1980.
Google Scholar
T. Flynn and R. Gray, “Encoding of correlated observations,” IEEE Trans. Inform. Theory, vol. 33, pp. 773–787, Nov. 1987.
10.1109/TIT.1987.1057384
Web of Science® Google Scholar
T. Berger, Z. Zhang, and H. Viswanathan, “The CEO problem,” IEEE Trans. Inform. Theory, vol. 42, pp. 887–902, May 1996.
10.1109/18.490552
Web of Science® Google Scholar
Y. Oohama, “The rate-distortion function for the quadratic Gaussian CEO problem,” IEEE Trans. Inform. Theory, vol. 44, pp. 1057–1070, May 1998.
10.1109/18.669162
Web of Science® Google Scholar
Y. Yang and Z. Xiong, “The supremum sum-rate loss of quadratic Gaussian direct multiterminal source coding,” in Proc. UCSD Workshop on Information Theory and Its Applications, San Diego, CA, Jan. 2008.
Google Scholar
A. Wagner, S. Tavildar, and P. Viswanath, “The rate region of the quadratic Gaussian two-terminal source-coding problem,” IEEE Trans. Inform. Theory, vol. 54, 2008.
10.1109/TIT.2008.920343
Web of Science® Google Scholar
C. Berrou and A. Glavieux, “Near optimum error correcting coding and decoding: turbo-codes,” IEEE Trans. Commun., vol. 44, pp. 1261–1271, Oct. 1996.
10.1109/26.539767
Web of Science® Google Scholar
R. Gallager, Low Density Parity Check Codes, Cambridge, MA: MIT Press, 1963.
10.7551/mitpress/4347.001.0001
Web of Science® Google Scholar
D. MacKay, “Good error-correcting codes based on very sparse matrices,” IEEE Trans. Inform. Theory, vol. 45, pp. 399–431, Mar. 1999.
10.1109/18.748992
Web of Science® Google Scholar
A. Liveris, Z. Xiong and C. Georghiades, “Compression of binary sources with side information at the decoder using LDPC codes,” IEEE Commun. Lett., vol. 6, pp. 440–442, Oct. 2002.
10.1109/LCOMM.2002.804244
Web of Science® Google Scholar
V. Stanković, A. Liveris, Z. Xiong, and C. Georghiades, “On code design for the general Slepian-Wolf problem and for lossless multiterminal communication networks,” IEEE Trans. Inform. Theory, vol. 52, pp. 1495–1507, Apr. 2006.
10.1109/TIT.2006.871046
Web of Science® Google Scholar
Z. Liu, S. Cheng, A. Liveris, and Z. Xiong, “Slepian-Wolf coded nested lattice quantization for Wyner-Ziv coding: High-rate performance analysis and code design,” IEEE Trans. Inform. Theory, vol. 52, pp. 4358–4379, Oct. 2006.
10.1109/TIT.2006.881833
Web of Science® Google Scholar
Y. Yang, S. Cheng, Z. Xiong, and W. Zhao, “Wyner-Ziv coding based on TCQ and LDPC codes,” IEEE Trans. Communications, vol. 57, pp. 376–387, Februaary 2009.
10.1109/TCOMM.2009.02.070287
Web of Science® Google Scholar
Y. Yang, V. Stankovic, Z. Xiong, and W. Zhao, “On multiterminal source code design,” IEEE Trans. Inform. Theory, vol. 54, pp. 2278–2302, May 2008.
10.1109/TIT.2008.920204
Web of Science® Google Scholar
B. Girod, A. Aaron, S. Rane, and D. Rebollo-Monedero, “Distributed video coding,” Proc. IEEE, vol. 93, pp. 71–83, Jan. 2005.
10.1109/JPROC.2004.839619
Web of Science® Google Scholar
T. Cover and J. Thomas, Elements of Information Theory, New York: Wiley, 1991.
10.1002/0471200611
Google Scholar
T. Cover, “A proof of the data compression theorem of Slepian and Wolf for ergodic sources,” IEEE Trans. Inform. Theory, vol. 22, pp. 226–228, Mar. 1975.
10.1109/TIT.1975.1055356
Web of Science® Google Scholar
A. Wyner, “The rate-distortion function for source coding with side information at the decoder—II: General sources,” Inform. Control, vol. 38, pp. 60–80, 1978.
10.1016/S0019-9958(78)90034-7
Web of Science® Google Scholar
R. Zamir, “The rate loss in the Wyner-Ziv problem,” IEEE Trans. Inform. Theory, vol. 42, pp. 2073–2084, Nov. 1996.
10.1109/18.556597
Web of Science® Google Scholar
S. Pradhan, J. Chou, and K. Ramchandran, “Duality between source coding and channel coding and its extension to the side information case,” IEEE Trans. Inform. Theory, vol. 49, pp. 1181–1203, May 2003.
10.1109/TIT.2003.810622
Web of Science® Google Scholar
Y. Oohama, “Gaussian multiterminal source coding,” IEEE Trans. Inform. Theory, vol. 43, pp. 1912–1923, Nov. 1997.
10.1109/18.641555
Web of Science® Google Scholar
Y. Oohama, “Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder,” IEEE Trans. Inform. Theory, vol. 51, pp. 2577–2593, July 2005.
10.1109/TIT.2005.850110
Web of Science® Google Scholar
A. Wyner, “Recent results in the Shannon theory,” IEEE Trans. Inform. Theory, vol. 20, pp. 2–10, Jan. 1974.
10.1109/TIT.1974.1055171
Web of Science® Google Scholar
S. Pradhan and K. Ramchandran, “Distributed source coding using syndromes (DISCUS): Design and construction,” IEEE Trans. Inform. Theory, vol. 49, pp. 626–643, Mar. 2003.
10.1109/TIT.2002.808103
Web of Science® Google Scholar
J. Garcia-Frias and Y. Zhao, “Compression of correlated binary sources using turbo codes,” IEEE Commun. Lett., vol. 5, pp. 417–419, Oct. 2001.
10.1109/4234.957380
Web of Science® Google Scholar
J. Bajcsy and P. Mitran, “Coding for the Slepian-Wolf problem with turbo codes,” in Proc. Globecom'01, San Antonio, TX, Nov. 2001.
Google Scholar
A. Aaron and B. Girod, “Compression with side information using turbo codes,” in Proc. DCC'02, Snowbird, UT, Apr. 2002.
Google Scholar
A. Liveris, Z. Xiong, and C. Georghiades, “Distributed compression of binary sources using conventional parallel and serial concatenated convolutional codes,” in Proc. DCC'03, Snowbird, UT, Mar. 2003.
Google Scholar
D. Van Renterghem, X. Jaspar, B. Macq, and L. Vandendorpe “Distributed source coding with optimized irregular turbo codes,” in Proc. ICC'07, Glasgow, Scotland, June 2007.
Google Scholar
T. Richardson, M. Shokrollahi, and R. Urbanke, “Design of capacity-approaching irregular low-density parity-check codes,” IEEE Trans. Inform. Theory, vol. 47, pp. 619–637, Feb. 2001.
10.1109/18.910578
Web of Science® Google Scholar
S. Cheng and Z. Xiong, “Successive refinement for the Wyner-Ziv problem and layered code design,” IEEE Trans. Signal Process., vol. 53, pp. 3269–3281, Aug. 2005.
10.1109/TSP.2005.851138
Web of Science® Google Scholar
N. Gehrig and P. Dragotti, “Symmetric and asymmetric Slepian-Wolf codes with systematic and nonsystematic linear codes,” IEEE Commun. Lett., vol. 9, pp. 61–63, Jan. 2005.
10.1109/LCOMM.2005.1375242
Web of Science® Google Scholar
M. Sartipi and F. Fekri, “Distributed source coding using short to moderate length rate-compatible LDPC codes: The entire Slepian-Wolf rate region,” IEEE Trans. Commun., vol. 56, pp. 400–411, Mar. 2008.
10.1109/TCOMM.2008.060006
Web of Science® Google Scholar
A. D. Liveris, Z. Xiong, and C. N. Georghiades, “Joint source-channel coding of binary sources with side information at the decoder using IRA codes,” in Proc. MMSP'02, St. Thomas, U.S. Virgin Islands, Dec. 2002.
Google Scholar
J. Garcia-Frias, Y. Zhao, and W. Zhong, “Turbo-like codes for transmission of correlated sources over noisy channels,” IEEE Signal Process. Mag., vol. 24, pp. 58–66, Sept. 2007.
10.1109/MSP.2007.904813
Web of Science® Google Scholar
D. Schonberg, K. Ramchandran, and S. S. Pradhan, “Distributed code constructions for the entire Slepian-Wolf rate region for arbitrarily correlated sources,” in Proc. DCC'04, Snowbird, UT, Mar. 2004.
Google Scholar
M. Fresia, L. Vandendorpe, and H. V. Poor “Distributed source coding using Raptor codes for hidden Markov sources,” in Proc. DCC'08, Snowbird, UT, Mar. 2008.
Google Scholar
A. Liveris, C. Lan, K. Narayanan, Z. Xiong, and C. Georghiades, “Slepian-Wolf coding of three binary sources using LDPC codes,” in Proc. Intl. Symp. Turbo Codes and Related Topics, Brest, France, Sept. 2003.
Google Scholar
C. Lan, A. Liveris, K. Narayanan, Z. Xiong, and C. Georghiades, “Slepian-Wolf coding of multiple M-ary sources using LDPC codes,” in Proc. DCC'04, Snowbird, UT, Mar. 2004.
Google Scholar
Y. Zhao and J. Garcia-Frias, “Data compression of correlated non-binary sources using punctured turbo codes,” in Proc. DCC'02, Snowbird, UT, Apr. 2002.
Google Scholar
J. Garcia-Frias and W. Zhong, “LDPC codes for compression of multiterminal sources with hidden Markov correlation,” IEEE Commun. Lett., pp. 115–117, Mar. 2003.
10.1109/LCOMM.2003.810001
Web of Science® Google Scholar
A. Eckford and W. Yu, “Rateless Slepian-Wolf codes,” in Proc. Asilomar Conf. Signals, Systems and Computers, Pacific Grove, CA, Nov. 2005.
Google Scholar
B. Ndzana, A. Shokrollahi, and J. Abel, “Fountain codes for the Slepian-Wolf problem,” in Proc. Allerton'06, Monticello, IL, Sept. 2006.
Google Scholar
J. Jiang, D. He, and A. Jagmohan, “Rateless Slepian-Wolf coding based on rate adaptive LDPC codes,” in Proc. ISIT'07, Nice, France, June 2007.
Google Scholar
G. Caire, S. Shamai, and S. Verdu, “Lossless data compression with low-density parity-check codes,” in Multiantenna Channels: Capacity, Coding and Signal Processing, G. Foschiniand S. Verdu (Eds.), Providence, RI: American Mathematical Society, 2003.
Google Scholar
M. Marcellin and T. Fischer, “Trellis coded quantization of memoryless and Gaussian-Markov sources,” IEEE Trans. Commun., vol. 38, pp. 82–93, Jan. 1990.
10.1109/26.46532
Web of Science® Google Scholar
M. Eyuboglu and D. Forney, Jr., “Lattice and trellis quantization with lattice- and trellis-bounded codebooks—high-rate theory for memoryless sources,” IEEE Trans. Inform. Theory, vol. 39, pp. 46–59, Jan. 1993.
10.1109/18.179341
Web of Science® Google Scholar
S. Shamai, S. Verdu, and R. Zamir, “Systematic lossy source/channel coding,” IEEE Trans. Inform. Theory, vol. 44, pp. 564–579, Mar. 1998.
10.1109/18.661505
Web of Science® Google Scholar
R. Zamir, S. Shamai, and U. Erez, “Nested linear/lattice codes for structured multiterminal binning,” IEEE Trans. Inform. Theory, vol. 48, pp. 1250–1276, June 2002.
10.1109/TIT.2002.1003821
Web of Science® Google Scholar
A. Liveris, Z. Xiong, and C. Georghiades, “Nested turbo codes for the binary Wyner-Ziv problem,” in Proc. ICIP'03, Barcelona, Spain, Sept. 2003.
Google Scholar
X. Wang and M. T. Orchard, “Design of trellis codes for source coding with side information at the decoder,” in Proc. DCC'01, Snowbird, UT, Mar. 2001.
Google Scholar
J. Chou, S. Pradhan, and K. Ramchandran, “Turbo and trellis-based constructions for source coding with side information,” in Proc. DCC'03, Snowbird, UT, Mar. 2003.
Google Scholar
D. Rebollo-Monedero, S. Rane, A. Aaron, and B. Girod, “High-rate quantization and transform coding with side information at the decoder,” Signal Process., vol. 86, pp. 3123–3130, Nov. 2006.
10.1016/j.sigpro.2006.03.015
Web of Science® Google Scholar
Y. Steinberg and N. Merhav, “On successive refinement for the Wyner-Ziv problem,” IEEE Trans. Inform. Theory, vol. 50, pp. 1636–1654, Aug. 2004.
10.1109/TIT.2004.831781
Web of Science® Google Scholar
W. Equitz and T. Cover, “Successive refinement of information,” IEEE Trans. Inform. Theory, vol. 37, pp. 269–274, Mar. 1991.
10.1109/18.75242
Web of Science® Google Scholar
Q. Xu and Z. Xiong, “Layered Wyner-Ziv video coding,” IEEE Trans. Image Process., vol., pp. 3791–3803, Dec. 2006.
10.1109/TIP.2006.884925
PubMed Web of Science® Google Scholar
S. Pradhan and K. Ramchandran, “Generalized coset codes for distributed binning,” IEEE Trans. Inform. Theory, vol. 51, pp. 3457–3474, Oct. 2005.
10.1109/TIT.2005.855584
Web of Science® Google Scholar
B. Rimoldi and R. Urbanke, “Asynchronous Slepian-Wolf coding via source-splitting,” in Proc. ISIT'97, Ulm, Germany, June 1997, p. 271.
Google Scholar
I. Csiszar and J. Korner, “Towards a general theory of source networks,” IEEE Trans. Inform. Theory, vol. 26, pp. 155–165, Mar. 1980.
10.1109/TIT.1980.1056166
Web of Science® Google Scholar
T. Han and K. Kobayashi, “A unified achievable rate region for a general class of multi-terminal source coding systems,” IEEE Trans. Inform. Theory, vol. 26, pp. 277–288, May 1980.
10.1109/TIT.1980.1056192
Web of Science® Google Scholar
R. Cristescu, B. Beferull-Lozano, and M. Vetterli, “Networked Slepian-Wolf: Theory, algorithms, and scaling laws,” IEEE Trans. Inform. Theory, vol. 51, pp. 4057–4073, Dec. 2005.
10.1109/TIT.2005.858980
Web of Science® Google Scholar
E. Martinian, S. Yekhanin, and J. Yedidia, “Secure biometrics via syndromes,” in Proc. Allerton'05, Monticello, IL, Oct. 2005.
Google Scholar
R. Ahlswede and I. Csiszar, “Common randomness in information theory and cryptography II: CR capacity,” IEEE Trans. Inform. Theory, vol. 44, pp. 225–240, Jan. 1998.
10.1109/18.651026
Web of Science® Google Scholar
I. Csiszar and P. Narayan, “Secrecy capacities for multiple terminals,” IEEE Trans. Inform. Theory, vol. 50, pp. 3047–3061, Dec. 2004.
10.1109/TIT.2004.838380
Web of Science® Google Scholar
MPEG-4 Video VM, ver. 13.0, ISO/IEC JTC 1/SC29/WG11 N2687, Mar. 1999.
Google Scholar
T. Wiegand, G. Sullivan, G. Bjintegaard, and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Trans. Circuits Syst. Video Tech., vol. 13, pp. 560–576, July 2003.
10.1109/TCSVT.2003.815165
Web of Science® Google Scholar
R. Puri, A. Majumdar, and K. Ramchandran, “PRISM: A video coding paradigm with motion estimation at the decoder,” IEEE Trans. Image Process., vol. 16, pp. 2436–2448, Oct. 2007.
10.1109/TIP.2007.904949
PubMed Web of Science® Google Scholar
C. Guillemot, F. Pereira, L. Torres, T. Ebrahimi, R. Leonardi, and J. Ostermann, “Distributed monoview and multiview video coding,” IEEE Signal Process. Mag., vol. 24, pp. 67–76, Sept. 2007.
10.1109/MSP.2007.904808
Web of Science® Google Scholar
D. He, A. Jagmohan, L. Lu, and V. Sheinin, “Wyner-Ziv video compression using rateless LDPC codes,” in Proc. VCIP'08, San Jose, CA, Jan. 2008.
Google Scholar
A. Sehgal, A. Jagmohan, and N. Ahuja, “Wyner-Ziv coding of video: Applications to error resilience,” IEEE Trans. Multimedia, vol. 6, pp. 249–258, Apr. 2004.
10.1109/TMM.2003.822995
Web of Science® Google Scholar
W. Li, “Overview of fine granularity scalability in MPEG-4 video standard,” IEEE Trans. Circuits Syst. Video Tech., vol. 11, pp. 301–317, Mar. 2001.
10.1109/76.911157
Google Scholar
Y. He, R. Yan, F. Wu, and S. Li, “H.26L-based fine granularity scalable video coding,” ISO/IEC MPEG 58th meeting, M7788, Pattaya, Thailand, Dec. 2001.
Google Scholar
Q. Xu, V. Stanković, and Z. Xiong, “Wyner-Ziv video compression and fountain codes for receiver-driven layered multicast,” IEEE Trans. Circuits Syst. Video Tech., vol. 17, pp. 901–906, July 2007.
10.1109/TCSVT.2007.897464
Web of Science® Google Scholar
Q. Xu, V. Stanković, and Z. Xiong, “Distributed source-channel coding of video using Raptor codes,” IEEE JSAC, vol. 25, pp. 851–861, May 2007.
Web of Science® Google Scholar
M. G. Luby, “LT codes,” in Proc. 43rd IEEE Symp. the Foundations of Computer Science, Vancouver, BC, Canada, Nov. 2002, pp. 271–280.
Google Scholar
A. Shokrollahi, “Raptor codes,” IEEE Trans. Inform. Theory, vol. 52, pp. 2551–2567, June 2006.
10.1109/TIT.2006.874390
Web of Science® Google Scholar
Special Issue on Models, Theory, and Codes for Relaying and Cooperation in Communication Networks, IEEE Trans. Inform. Theory, vol. 53, Oct. 2007.
Google Scholar
T. Cover and A. El Gamal, “Capacity theorems for the relay channel,” IEEE Trans. Inform. Theory, vol. 25, pp. 572–584, Sept. 1979.
10.1109/TIT.1979.1056084
Web of Science® Google Scholar
Z. Liu, V. Stankovic, and Z. Xiong, “Wyner-Ziv coding for the half-duplex relay channel,” in Proc. ICASSP'05, Philadelphia, PA, Mar. 2005.
Google Scholar
A. Carleial, “Interference channels,” IEEE Trans. Inform. Theory, vol. 24, pp. 60–70, Jan. 1978.
10.1109/TIT.1978.1055812
Web of Science® Google Scholar
A. Høst-Madsen, “Capacity bounds for cooperative diversity,” IEEE Trans. Inform. Theory, vol. 52, pp. 1522–1544, Apr. 2006.
10.1109/TIT.2006.871576
Web of Science® Google Scholar
M. Uppal, Z. Liu, V. Stanković, A. Høst-Madsen, and Z. Xiong, “Capacity bounds and code designs for cooperative diversity,” in Proc. UCSD Workshop on Information Theory and Its Applications, San Diego, CA, Feb. 2006.
Google Scholar
Y. Yang, V. Stanković, Z. Xiong, and W. Zhao, “Two-terminal video coding,” IEEE Trans. Image Processing, vol. 18, pp. 534–551, March 2009.
10.1109/TIP.2008.2010148
PubMed Web of Science® Google Scholar

Citing Literature

Handbook on Array Processing and Sensor Networks