CODING FOR CHANNELS WITH FEEDBACK
|
|
- Polly Goodwin
- 5 years ago
- Views:
Transcription
1 CODING FOR CHANNELS WITH FEEDBACK
2 THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE
3 CODING FOR CHANNELS WITH FEEDBACK by JamesM.Ooi The Cambridge Analytic Group SPRINGER SCIENCE+BUSINESS MEDIA, LLC
4 ISBN DOI / ISBN (ebook) Library of Congress Cataloging-in-Publication Data A C.I.P. Catalogue record for this book is available from the Library of Congress. Copyright 1998 by Springer Science+Business Media New York Originally published by Kluwer Academic Publishers in 1998 Softcover reprint ofthe hardcover Ist edition 1998 AII rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, mechanical, photocopying, recording, or otherwise, without the prior written permission of the publisher, Springer Science+Business Media, LLC Printed on acid-free paper.
5 DEDICATED TO MY FATHER: BOON SENG 001 APRIL 21, OCTOBER 29, 1997
6 Contents Preface Acknowledgments Notation and Abbreviations 1 Introduction 1.1 Feedback in Communication. 1.2 Overview. References xiii xvii xix DMCs: An Introduction to the Framework Introduction Variable-Length Codes and Their Properties: Rate, Reliability, and Complexity A Feedback Coding Scheme for DMCf's Encoding Decoding Reliability Removing the Perfect-Detection Assumption Reliability of the Modified Scheme Complexity Time and Space Complexity for the Transmitter and Receiver Uniform Versus Non-Uniform Complexity Variations Scheme Using a Fixed-Length Precoder and Source Coder Discussion Structuring Computation Variability of Transmission Length Number of Iterations Feedback Delay Inaccurate Channel Modeling Simulation Summary and Future Directions Appendix to Chapter A Proof of Subsystem Property
7 x CONTENTS 2.B Proof of Subsystem Property 2 2.C Proof of Subsystem Property 3 2.D Proof of Lemma E Proof of Lemma F Proof of Subsystem Property 4 2.G Modified Scheme Reliability.. 2.H Precoding with Linear Complexity. 2.1 Fixed-Length Precoding and Source Coding Subsystems Fixed-Length Precoder Fixed-Length Source Coder Analysis of Variable-Length Interleaving. References Channels with Memory Introduction Generalization of the Coding Scheme A Coding Scheme for DFSCf's Precoder Source Coder Synchronization Sequence and Detector Termination Coder-Modified Schalkwijk-Barron Coder Complexity Discussion Choosing the Synchronization and msb Sequences Beyond Feedback-Free Capacity Computational Delays Fixed-Length Precoding and Source Coding Summary and Future Directions Appendix to Chapter A Ergodic Finite-Order Markov Input to Indecomposable DFSC f 's 76 3.B Efficiency Property of the Precoder C Interaction between Precoder and Source Coder D A Fast Algorithm for Conditional Shannon-Fano Source Coding E Synchronization-Sequence Detection F Lemmas Relating to Entropy Rates. 94 References Unknown Channels Introduction Formulation of Variable-Length Coding for Unknown Channels A Universal Communication Scheme for a Class ofufsc's Precoder and Source Coder Synchronization Subsystem
8 CONTENTS xi Termination Codes Complexity Uniform Convergence Discussion Choice of input distribution Computational Delays and Maximum Quality Summary and Future Directions Appendix to Chapter III 4.A Properties of the Conditional Lempel-Ziv Coder... III 4.B Universal Detection of the Synchronization Sequence 115 References Multiple-Access Channels Introduction Formulation of Variable-Length Coding for Two-User Multiple Access Channels Low-Complexity Coding Scheme for Two-User Multiple-Access Channels Encoders Performance Analysis Reliability Complexity Discussion Achieving Other Rate Pairs Variations Beyond the Feedback-Free Capacity Region Summary and Future Directions 136 Appendix to Chapter A Fixed-Length Source Coder for Tx References Channels with Partial and Noisy Feedback Introduction Feedback Rate Reduction An Approach Based on Slepian-Wolf Coding A Reduced-Feedback-Rate Coding Scheme for BSC's Performance Analysis of the Modified Scheme Comments on Slepian-Wolf Coded Feedback for General DMC's A Concatenated Coding Framework for Combining FEC Codes with Feedback Codes Main Idea Superchannels Induced by Strong Inner Codes Superchannels Induced by Weak Inner Codes. 156
9 xii CONTENTS Computational Comparison with Feedback-Free Linear Complexity Concatenated Coding Scheme Feedback Coding on the Erasure Channel and ARQ Coping with Noisy Feedback Discussion Multiple-Access Channels with Partial Feedback An Alternative View of Coding with Partial Feedback Summary and Future Directions. 166 References Conclusions 169
10 Preface Since the introduction of the coding theorem in 1948, the main obstacle to realizing the performance promised by this theorem has been computational complexity. While researchers realized in the 50's and 60's that the presence of feedback on a communication link enables one to construct low-complexity coding schemes, the flurry of excitement over the first low-complexity capacity-achieving feedback coding schemes subsided over the next two decades. But there has been a recent resurgence of interest in feedback communication systems as the intense efforts in feedback-free communication for even the simplest channel models have been only partly successful. This monograph, which is based on my doctoral research at the Massachusetts Institute of Technology, presents both algorithms for feedback coding and performance analyses of these algorithms, including analyses of perhaps the most important performance criterion: computational complexity. The algorithms are developed within a single framework, which I term the compressed-error-cancellation framework. In this framework, data are sent via a sequence of messages: the first message contains the original data; each subsequent message contains a source-coded description of the channel distortions introduced on the message preceding it. The ideas behind this extraordinarily simple and elegant framework first appeared 25 years ago as a tool for proving theoretical results about feedback communication systems. Yet, despite the usual emphasis of information theory on elegant theoretical results, a substantial fraction of practicing information theorists are unaware of these ideas. By exhibiting the usefulness and flexibility of this framework for deriving low-complexity solutions to a wide variety of feedback communication problems, I hope awareness of these ideas will increase. Indeed, one of the research contributions of this monograph is to show that the compressed-error-cancellation framework leads to practical solutions and is applicable to a wide variety of problems. It was previously thought that the compressed-errorcancellation framework led only to coding schemes with high computational complexity; furthermore, the framework had only been applied to discrete memoryless channels with feedback and certain arbitrarily varying channels with feedback. I show in this monograph that the framework leads to coding schemes with the lowest possible asymptotic order of growth of computations and can be applied to channels with memory, unknown channnels, multiple-access channels, all with complete noiseless feedback, as well as to channels with partial and noisy feedback. I believe that practitioners, researchers, and students alike can appreciate this monograph, which requires only working knowledge of information theory and probability theory. For practitioners, high-performance algorithms are explicitly developed
11 xiv Preface for some of the most challenging communication problems. For researchers, new insights are presented into challenging research questions on feedback communication, and many directions for future research are suggested. For the student, a rather different perspective on information theory is provided that ties source coding and channel coding explicitly together. The monograph is organized into seven chapters. The first and last chapters provide introductory and summary material, respectively. The middle chapters are divided by the type of communication scenario to be addressed within our unified framework, ranging from the simplest scenario to more complex. Specifically, Chapter 2 provides an introduction to the basic framework in the context of applying the basic framework to developing low-complexity coding schemes for discrete memory less channels with complete, noiseless feedback. The coding problem with feedback is formulated, and a coding scheme exploiting low-complexity lossless source coding algorithms is developed. Notions of computational complexity are discussed, and the associated encoder and decoder are shown to use a number of computations growing only linearly with the number of channel inputs used (linear complexity). The associated error exponent is shown to be optimal in an appropriate sense and implies that capacity is achievable. Simulation results are reported to confirm the analytically predicted behavior. In Chapter 3, channels with memory and noiseless feedback are considered. Channels with memory are becoming increasingly important models for contemporary communication systems, especially wireless systems. In particular, for the sake of mathematical tractability, I focus on the class of channels with memory known as discrete finitestate channels with complete, noiseless feedback, which form an extremely flexible class of channels with memory. The framework is used to develop linear-complexity coding schemes performing analogously in terms of rate and reliability to the schemes developed for discrete memory less channels. Chapter 4 explores the use of the framework for coding over unknown channels with feedback. Unknown channels model the scenario in which the channel varies with time slowly in an unknown way. The availability of feedback introduces the possibility of channel-dependent communication performance. In particular, this chapter introduces the notion of universal communication, whereby communication over an unknown channel with feedback takes place and results in an effective transmission rate that varies with the quality of the realized channel. A linear-complexity universal communication scheme is developed and analyzed within the framework. The asymptotic rate and reliability characteristics of this universal scheme are shown to be similar to those of the schemes developed for known channels. In Chapter 5, an extension of the compressed-error-cancellation framework is developed for discrete memory less multiple-access channels with complete, noiseless feedback, which are important models for contemporary communication networks. This extended framework leads to linear-complexity coding schemes achieving rates on the frontier of the feedback-free capacity region. In Chapter 6 the compressed-error-cancellation framework is applied to the prac-
12 Coding for Channels with Feedback xv tically important problem of coding for channels with noisy and partial feedback. The scheme developed for discrete memory less channels with feedback is modified to incorporate Slepian-Wolf coded feedback, resulting in a linear-complexity, capacityachieving coding scheme with partial, noiseless feedback. This modified scheme, of which the popular automatic-repeat-request protocol is shown to be a special case, is then used as an outer code in a concatenated coding arrangement; with a forward errorcorrecting (FEC) code used as the inner code, a framework emerges for integrating FEC coding with feedback coding, leading to a broad class of coding schemes using various amounts of noiseless feedback. Preliminary investigations on partial-feedback multiple-access scenarios and noisy feedback scenarios are also discussed.
13 Acknowledgments It is my privilege to mention here a number of individuals whose efforts made this monograph possible. My thesis supervisor at MIT, Professor Gregory Wornell, provided excellent technical and literary guidance that greatly improved the content and and presentation of my doctoral thesis upon which this monograph is based; I sincerely thank him for his efforts. The other members of my thesis committee, Professors Amos Lapidoth and Robert Gallager, inspired important developments in my doctoral thesis. My colleagues, Jeff Ludwig and Shawn Verbout, influenced my thinking immeasurably on a variety of subjects related to this monograph. Finally, I thank my partner in life, Amy Yin, for her love and support while completing my doctoral thesis and this monograph. I must also mention that this monograph could not have been completed without the resources of the Digital Signal Processing Group in the MIT Research Laboratory of Electronics and the generous financial support given by the Defense Advanced Research Projects Agency, the Office of Naval Research, AT&T, Lucent Technologies, and the MIT Electrical Engineering and Computer Science Department.
14 Notation and Abbreviations An important notational convention of which we must be aware at this point is that if X is a discrete random variable, then p x automatically denotes its probability mass function (pmt), and E[X] automatically denotes its expected value. Standard adjustments to this notation are used for conditional and joint pmfs and expectations. Remaining notational conventions and abbreviations are introduced as needed throughout the thesis (often in footnotes). For reference, we summarize here some important conventions and abbreviations, which should be assumed to hold unless otherwise stated Abbreviations: Bernoulli-t: ~ Bernoulli with probability of equaling one being t: BSC ~ binary symmetric channel BSCf ~ BSC with complete noiseless feedback BSCpf ~ BSC with partial noiseless feedback cdf ~ cumulative distribution function CSWCF ~ concatenated Slepian-Wolf coded feedback DFSC ~ discrete finite-state channel DFSCf ~ DFSC with complete noiseless feedback DFSCpf ~ DFSC with partial noiseless feedback DMC ~ discrete memoryless channel DMCf ~ DMC with complete noiseless feedback DMCpf ~ DMC with partial noiseless feedback DMMAC ~ discrete memoryless multiple-access channel DMMACf ~ DMMAC with complete noiseless feedback DMMACpf ~ DMMAC with partial noiseless feedback FEC ~ forward error-correcting i.i.d. ~ independent and identically distributed MABC ~ multiple-access broadcast channel pmf ~ probability mass function SWCF ~ Slepian-Wolf coded feedback UFSC ~ unknown DFSC UFSCf ~ UFSC with complete noiseless feedback UFSCpf ~ UFSC with partial noiseless feedback
15 xx Notation and Abbreviations Notational Conventions: o -t marks the end of a proof (0.1) 'il -t marks the end of a proof of a lemma introduced within a larger proof (0.2) x[ J -t square brackets have no general meaning; they are used as an alternative or in addition to super- and subscripts. (0.3) On(g(n)) -t a function in the set {f(n) limn... oo f(n)/g(n) = O} (0.4) On(g(n)) -t a function in the set {f(n) liminfn... oo f(n)/g(n) ~ and limsupn... oo f(n)/g(n) < co} (0.5) 6 n(g(n)) -t a function in the set {f(n) liminfn... oo f(n)/g(n) > and Z -t the set of integers lr -t the set of real numbers N -t the set of natural numbers ({O, 1,2,... }) IA I -t cardinality of the set A coa -t convex hull of the subset A of Euclidean space An -t n-fold Cartesian product of A with itself At -t the set of variable-length tuples with elements in A: At = U~=lAn a! -t (as,'..,at) a';' -t (as, ash,". ) an -t a~ f( a) -t length of variable-length tuple a: f(a)=nifaean i=l limsupn... oo f(n)/g(n) < co} (0.6) x[nj -t nth M-ary expansion digit of x E [0, IJ, where M is determined from (0.7) (0.8) (0.9) (0.10) (0.11) (0.12) (0.13) (0.14) (0.15) (0.16) (0.17) (0.18) context. When two expansions exist, the one ending with zeros is taken. (0.19) [tj ( ) x[.j -t x[.]>, x[tj x[tj -t x[tj [lj x t Y -t X converges to y from below r x 1 -t ceiling of x: rxl = min{z: z E Z,z ~ x} log x -t base-2 logarithm of x In x -t natural logarithm of x (0.20) (0.21) (0.22) (0.23) (0.24) (0.25)
16 Coding for Channels with Feedback xxi exp2 {X} -t 2 x exp{ x} -t ex (0.26) (0.27) Pr{ A} -t probability of an event A (0.28) Pr{AI23} -t probability of an event A conditioned on the event 23 (0.29) px -t probability mass function (pmf) for X: px(x) = Pr{X = x} (0.30) PXIY -t pmffor X conditioned on Y: PXly(xly) = Pr{X = xly = y} (0.31) E[X] -t expected value of the random variable X: E[X] = LXPx(x) (0.32) var(x) -t variance of the random variable X: var(x) = L(x - E[X])2pX(X) std(x) -t standard deviation of the random variable X: std(x) = vvar(x) H 2 ( f) -t binary entropy function: H2(f) = -dog f - (1 - f) log(l - f) H(X) -t entropy of random variable X: H(X) = - LPx(x) logpx(x) H (X, Y) -t joint entropy of random variables X and Y: H(X,Y) = - LPX,y(x,y}logpx,Y(x,y) X,Y H(XIY} -t conditional entropy of X given Y: H(XIY) = H(X, Y) - H(Y} J(Xj Y) -t mutual information between X and Y: J(Xj Y} = H(X) + H(Y} - H(X, Y) H 00 (Xoo) -t entropy rate of random process Xoo: Hoo(Xoo) = lim.!.h(xn) n-+oo n Hoo(X oo, y oo ) -t joint entropy rate of random processes X OO and y oo : Hoo (Xoo, y oo ) = lim.!.h(xn, yn) n-+oo n Hoo(XooIY oo ) -t conditional entropy rate XOO conditioned on y oo : Hoo(XooIY oo ) = Hoo(Xoo, y oo ) _ H(Yoo) D2 (f II a) -t Kullback-Leibler distance between two Bernoulli pmfs with parameters f and a: f 1-f D2(f II a) = dog - + (1- f}log -1- a -a (0.33) (0.34) (0.35) (0.36) (0.37) (0.38) (0.39) (0.40) (0.41) (0.42) (0.43)
17 xxii Notation and Abbreviations D(P II q) """* Kullback-Leibler distance between pmfs p and q: D(p II q) = l>(x) log :~:~., (0.44)
Lecture 16: Feedback channel and source-channel separation
Lecture 16: Feedback channel and source-channel separation Feedback channel Source-channel separation theorem Dr. Yao Xie, ECE587, Information Theory, Duke University Feedback channel in wireless communication,
More informationUC Berkeley UC Berkeley Previously Published Works
UC Berkeley UC Berkeley Previously Published Works Title Zero-rate feedback can achieve the empirical capacity Permalink https://escholarship.org/uc/item/7ms7758t Journal IEEE Transactions on Information
More informationTHE advent of digital communications in radio and television
564 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 44, NO. 2, MARCH 1998 Systematic Lossy Source/Channel Coding Shlomo Shamai (Shitz), Fellow, IEEE, Sergio Verdú, Fellow, IEEE, and Ram Zamir, Member, IEEE
More informationAnalysis of Video Transmission over Lossy Channels
1012 IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 18, NO. 6, JUNE 2000 Analysis of Video Transmission over Lossy Channels Klaus Stuhlmüller, Niko Färber, Member, IEEE, Michael Link, and Bernd
More informationOn the design of turbo codes with convolutional interleavers
University of Wollongong Research Online University of Wollongong Thesis Collection 1954-2016 University of Wollongong Thesis Collections 2005 On the design of turbo codes with convolutional interleavers
More informationExample: compressing black and white images 2 Say we are trying to compress an image of black and white pixels: CSC310 Information Theory.
CSC310 Information Theory Lecture 1: Basics of Information Theory September 11, 2006 Sam Roweis Example: compressing black and white images 2 Say we are trying to compress an image of black and white pixels:
More informationIN a point-to-point communication system the outputs of a
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 52, NO. 9, SEPTEMBER 2006 4017 On the Structure of Optimal Real-Time Encoders Decoders in Noisy Communication Demosthenis Teneketzis, Fellow, IEEE Abstract
More informationDistributed Video Coding Using LDPC Codes for Wireless Video
Wireless Sensor Network, 2009, 1, 334-339 doi:10.4236/wsn.2009.14041 Published Online November 2009 (http://www.scirp.org/journal/wsn). Distributed Video Coding Using LDPC Codes for Wireless Video Abstract
More informationMinimax Disappointment Video Broadcasting
Minimax Disappointment Video Broadcasting DSP Seminar Spring 2001 Leiming R. Qian and Douglas L. Jones http://www.ifp.uiuc.edu/ lqian Seminar Outline 1. Motivation and Introduction 2. Background Knowledge
More informationWYNER-ZIV VIDEO CODING WITH LOW ENCODER COMPLEXITY
WYNER-ZIV VIDEO CODING WITH LOW ENCODER COMPLEXITY (Invited Paper) Anne Aaron and Bernd Girod Information Systems Laboratory Stanford University, Stanford, CA 94305 {amaaron,bgirod}@stanford.edu Abstract
More informationNUMEROUS elaborate attempts have been made in the
IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 46, NO. 12, DECEMBER 1998 1555 Error Protection for Progressive Image Transmission Over Memoryless and Fading Channels P. Greg Sherwood and Kenneth Zeger, Senior
More information1360 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 3, MARCH Optimal Encoding for Discrete Degraded Broadcast Channels
1360 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL 59, NO 3, MARCH 2013 Optimal Encoding for Discrete Degraded Broadcast Channels Bike Xie, Thomas A Courtade, Member, IEEE, Richard D Wesel, SeniorMember,
More informationIMAGE AND TEXT COMPRESSION
IMAGE AND TEXT COMPRESSION THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE COMMUNICATIONS AND INFORMATION TIlEORY Other books in the series: Consulting Editor: Robert Gallager Digital
More informationMathematical Principles of Fuzzy Logic
Mathematical Principles of Fuzzy Logic THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE MATHEMATICAL PRINCIPLES OF FUZZY LOGIC VILEM N O V K University of Ostrava Institute for Research
More informationDELTA MODULATION AND DPCM CODING OF COLOR SIGNALS
DELTA MODULATION AND DPCM CODING OF COLOR SIGNALS Item Type text; Proceedings Authors Habibi, A. Publisher International Foundation for Telemetering Journal International Telemetering Conference Proceedings
More information2550 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 6, JUNE 2008
2550 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 6, JUNE 2008 Distributed Source Coding in the Presence of Byzantine Sensors Oliver Kosut, Student Member, IEEE, Lang Tong, Fellow, IEEE Abstract
More informationWyner-Ziv Coding of Motion Video
Wyner-Ziv Coding of Motion Video Anne Aaron, Rui Zhang, and Bernd Girod Information Systems Laboratory, Department of Electrical Engineering Stanford University, Stanford, CA 94305 {amaaron, rui, bgirod}@stanford.edu
More informationDigital Audio and Video Fidelity. Ken Wacks, Ph.D.
Digital Audio and Video Fidelity Ken Wacks, Ph.D. www.kenwacks.com Communicating through the noise For most of history, communications was based on face-to-face talking or written messages sent by courier
More informationMULTIMEDIA SIGNALS AND SYSTEMS
MULTIMEDIA SIGNALS AND SYSTEMS THE KLUWER INTERNATIONAL SERIES IN ENGINEERING AND COMPUTER SCIENCE MULTIMEDIA SIGNALS ANDSYSTEMS Mrinal Kr. Mandal University of Alberta, Canada SPRINGER SCIENCE+BUSINESS
More informationLattice-Ordered Groups. An Introduction
Lattice-Ordered Groups An Introduction Reidel Texts in the Mathematical Sciences A Graduate-Level Book Series Lattice-Ordered Groups An Introduction by Marlow Anderson The Colorado College, Colorado Springs,
More informationLOCALITY DOMAINS IN THE SPANISH DETERMINER PHRASE
LOCALITY DOMAINS IN THE SPANISH DETERMINER PHRASE Studies in Natural Language and Linguistic Theory VOLUME 79 Managing Editors Marcel den Dikken, City University of New York Liliane Haegeman, University
More informationA Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com A Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding Min Wu, Anthony Vetro, Jonathan Yedidia, Huifang Sun, Chang Wen
More informationREDUCED-COMPLEXITY DECODING FOR CONCATENATED CODES BASED ON RECTANGULAR PARITY-CHECK CODES AND TURBO CODES
REDUCED-COMPLEXITY DECODING FOR CONCATENATED CODES BASED ON RECTANGULAR PARITY-CHECK CODES AND TURBO CODES John M. Shea and Tan F. Wong University of Florida Department of Electrical and Computer Engineering
More informationContents. xv xxi xxiii xxiv. 1 Introduction 1 References 4
Contents List of figures List of tables Preface Acknowledgements xv xxi xxiii xxiv 1 Introduction 1 References 4 2 Digital video 5 2.1 Introduction 5 2.2 Analogue television 5 2.3 Interlace 7 2.4 Picture
More informationJoint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes. Digital Signal and Image Processing Lab
Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes Digital Signal and Image Processing Lab Simone Milani Ph.D. student simone.milani@dei.unipd.it, Summer School
More informationInvestigation of the Effectiveness of Turbo Code in Wireless System over Rician Channel
International Journal of Networks and Communications 2015, 5(3): 46-53 DOI: 10.5923/j.ijnc.20150503.02 Investigation of the Effectiveness of Turbo Code in Wireless System over Rician Channel Zachaeus K.
More informationImplementation of a turbo codes test bed in the Simulink environment
University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2005 Implementation of a turbo codes test bed in the Simulink environment
More informationRate-Adaptive Codes for Distributed Source Coding
Rate-Adaptive Codes for Distributed Source Coding David Varodayan, Anne Aaron and Bernd Girod Information Systems Lab., Dept. of Electrical Engineering Stanford University, Stanford, CA 94305, USA Abstract
More informationAN UNEQUAL ERROR PROTECTION SCHEME FOR MULTIPLE INPUT MULTIPLE OUTPUT SYSTEMS. M. Farooq Sabir, Robert W. Heath and Alan C. Bovik
AN UNEQUAL ERROR PROTECTION SCHEME FOR MULTIPLE INPUT MULTIPLE OUTPUT SYSTEMS M. Farooq Sabir, Robert W. Heath and Alan C. Bovik Dept. of Electrical and Comp. Engg., The University of Texas at Austin,
More informationHYDRAULIC AND ELECTRIC-HYDRAULIC CONTROL SYSTEMS
HYDRAULIC AND ELECTRIC-HYDRAULIC CONTROL SYSTEMS Hydraulic and Electric-Hydraulic Control Systems Second Enlarged Edition by R.B. WALTERS Engineering Consultant. Wembley, U.K. SPRINGER-SCTENCE+BUSINESS
More informationChapter 2. Advanced Telecommunications and Signal Processing Program. E. Galarza, Raynard O. Hinds, Eric C. Reed, Lon E. Sun-
Chapter 2. Advanced Telecommunications and Signal Processing Program Academic and Research Staff Professor Jae S. Lim Visiting Scientists and Research Affiliates M. Carlos Kennedy Graduate Students John
More informationNATIONAL INSTITUTE OF TECHNOLOGY CALICUT ACADEMIC SECTION. GUIDELINES FOR PREPARATION AND SUBMISSION OF PhD THESIS
NATIONAL INSTITUTE OF TECHNOLOGY CALICUT ACADEMIC SECTION GUIDELINES FOR PREPARATION AND SUBMISSION OF PhD THESIS I. NO OF COPIES TO BE SUBMITTED TO ACADEMIC SECTION Four softbound copies of the thesis,
More informationA Hybrid Theory of Metaphor
A Hybrid Theory of Metaphor A Hybrid Theory of Metaphor Relevance Theory and Cognitive Linguistics Markus Tendahl University of Dortmund, Germany Markus Tendahl 2009 Softcover reprint of the hardcover
More informationCOMP 249 Advanced Distributed Systems Multimedia Networking. Video Compression Standards
COMP 9 Advanced Distributed Systems Multimedia Networking Video Compression Standards Kevin Jeffay Department of Computer Science University of North Carolina at Chapel Hill jeffay@cs.unc.edu September,
More informationResearch Article. ISSN (Print) *Corresponding author Shireen Fathima
Scholars Journal of Engineering and Technology (SJET) Sch. J. Eng. Tech., 2014; 2(4C):613-620 Scholars Academic and Scientific Publisher (An International Publisher for Academic and Scientific Resources)
More informationDiscriminatory Lossy Source Coding: Side Information Privacy
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 9, SEPTEMBER 2013 5665 Discriminatory Lossy Source Coding: Side Information Privacy Ravi Tandon, Member, IEEE, Lalitha Sankar, Member, IEEE, and H.
More informationStudies in Natural Language and Linguistic Theory
THE MANDARIN VP Studies in Natural Language and Linguistic Theory VOLUME 44 Managing Editors Liliane Haegeman, University a/geneva Joan Maling, Brandeis University James McCloskey, University a/california,
More informationORTHOGONAL frequency division multiplexing
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 55, NO. 12, DECEMBER 2009 5445 Dynamic Allocation of Subcarriers and Transmit Powers in an OFDMA Cellular Network Stephen Vaughan Hanly, Member, IEEE, Lachlan
More informationBirkhäuser Advanced Texts
Birkhäuser Advanced Texts Basler Lehrbücher Edited by Herbert Amann, University of Zürich Steven G. Krantz, Washington University, St. Louis Shrawan Kumar, University of North Carolina at Chapel Hili Steven
More informationHYBRID CONCATENATED CONVOLUTIONAL CODES FOR DEEP SPACE MISSION
HYBRID CONCATENATED CONVOLUTIONAL CODES FOR DEEP SPACE MISSION Presented by Dr.DEEPAK MISHRA OSPD/ODCG/SNPA Objective :To find out suitable channel codec for future deep space mission. Outline: Interleaver
More informationA NOTE ON FRAME SYNCHRONIZATION SEQUENCES
A NOTE ON FRAME SYNCHRONIZATION SEQUENCES Thokozani Shongwe 1, Victor N. Papilaya 2 1 Department of Electrical and Electronic Engineering Science, University of Johannesburg P.O. Box 524, Auckland Park,
More informationDie Grundlehren der mathematischen Wissenschaften
Die Grundlehren der mathematischen Wissenschaften in Einzeldarstellungen mit besonderer Beriicksichtigung der Anwendungsgebiete Band 196 llerausgegeben von J. L. Doob. A. Grothendieck. E. Heinz F. Hirzebruch
More informationModeling and Optimization of a Systematic Lossy Error Protection System based on H.264/AVC Redundant Slices
Modeling and Optimization of a Systematic Lossy Error Protection System based on H.264/AVC Redundant Slices Shantanu Rane, Pierpaolo Baccichet and Bernd Girod Information Systems Laboratory, Department
More informationAdaptive decoding of convolutional codes
Adv. Radio Sci., 5, 29 214, 27 www.adv-radio-sci.net/5/29/27/ Author(s) 27. This work is licensed under a Creative Commons License. Advances in Radio Science Adaptive decoding of convolutional codes K.
More informationQuality Assurance in Seafood Processing: A Practical Guide
Quality Assurance in Seafood Processing: A Practical Guide Quality Assurance in Seafood Processing: A Practical Guide A. D. Bonnell SPRINGER-SCIENCE+BUSINESS MEDIA, B.V. 1994 Springer Science+Business
More informationNumerical Analysis. Ian Jacques and Colin Judd. London New York CHAPMAN AND HALL. Department of Mathematics Coventry Lanchester Polytechnic
Numerical Analysis Numerical Analysis Ian Jacques and Colin Judd Department of Mathematics Coventry Lanchester Polytechnic London New York CHAPMAN AND HALL First published in 1987 by Chapman and Hall Ltd
More informationOptimization of Multi-Channel BCH Error Decoding for Common Cases. Russell Dill Master's Thesis Defense April 20, 2015
Optimization of Multi-Channel BCH Error Decoding for Common Cases Russell Dill Master's Thesis Defense April 20, 2015 Bose-Chaudhuri-Hocquenghem (BCH) BCH is an Error Correcting Code (ECC) and is used
More informationLAYERED WYNER-ZIV VIDEO CODING FOR NOISY CHANNELS. A Thesis QIAN XU
LAYERED WYNER-ZIV VIDEO CODING FOR NOISY CHANNELS A Thesis by QIAN XU Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of the requirements for the degree of MASTER
More informationAbbreviations and Acronyms in Medicine and Nursing
Abbreviations and Acronyms in Medicine and Nursing SOLOMON GARB, M.D., F.A.C.P. Scientific Director, Associate Clinica[ Professor of Medicine, University ofcolorado Me.dical College ELEANOR KRAKAUER Medical
More informationTERRESTRIAL broadcasting of digital television (DTV)
IEEE TRANSACTIONS ON BROADCASTING, VOL 51, NO 1, MARCH 2005 133 Fast Initialization of Equalizers for VSB-Based DTV Transceivers in Multipath Channel Jong-Moon Kim and Yong-Hwan Lee Abstract This paper
More informationSystematic Lossy Error Protection of Video based on H.264/AVC Redundant Slices
Systematic Lossy Error Protection of based on H.264/AVC Redundant Slices Shantanu Rane and Bernd Girod Information Systems Laboratory Stanford University, Stanford, CA 94305. {srane,bgirod}@stanford.edu
More informationVideo coding standards
Video coding standards Video signals represent sequences of images or frames which can be transmitted with a rate from 5 to 60 frames per second (fps), that provides the illusion of motion in the displayed
More informationDesign of Polar List Decoder using 2-Bit SC Decoding Algorithm V Priya 1 M Parimaladevi 2
IJSRD - International Journal for Scientific Research & Development Vol. 3, Issue 03, 2015 ISSN (online): 2321-0613 V Priya 1 M Parimaladevi 2 1 Master of Engineering 2 Assistant Professor 1,2 Department
More informationTrue Random Number Generation with Logic Gates Only
True Random Number Generation with Logic Gates Only Jovan Golić Security Innovation, Telecom Italia Winter School on Information Security, Finse 2008, Norway Jovan Golic, Copyright 2008 1 Digital Random
More informationCONSIDER the problem of transmitting two correlated
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 6, JUNE 2013 3619 Separate Source Channel Coding for Transmitting Correlated Gaussian Sources Over Degraded Broadcast Channels Yang Gao Ertem Tuncel,
More informationIEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 6, JUNE Since this work considers feedback schemes where the roles of transmitter
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 56, NO. 6, JUNE 2010 2845 Multiuser MIMO Achievable Rates With Downlink Training and Channel State Feedback Giuseppe Caire, Fellow, IEEE, Nihar Jindal, Member,
More informationUTILIZATION OF MATLAB FOR THE DIGITAL SIGNAL TRANSMISSION SIMULATION AND ANALYSIS IN DTV AND DVB AREA. Tomáš Kratochvíl
UTILIZATION OF MATLAB FOR THE DIGITAL SIGNAL TRANSMISSION SIMULATION AND ANALYSIS IN DTV AND DVB AREA Tomáš Kratochvíl Institute of Radio Electronics, Brno University of Technology Faculty of Electrical
More informationSynchronization Techniques for Digital Receivers
Synchronization Techniques for Digital Receivers Applications of Communications Theory Series Editor: R. W. Lucky, Bellcore Editorial Board: Anthony S. Acampora, University of Southern California Tingye
More informationTHE CAPABILITY of real-time transmission of video over
1124 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 9, SEPTEMBER 2005 Efficient Bandwidth Resource Allocation for Low-Delay Multiuser Video Streaming Guan-Ming Su, Student
More informationCopyright Warning & Restrictions
Copyright Warning & Restrictions The copyright law of the United States (Title 17, United States Code) governs the making of photocopies or other reproductions of copyrighted material. Under certain conditions
More informationPart 2.4 Turbo codes. p. 1. ELEC 7073 Digital Communications III, Dept. of E.E.E., HKU
Part 2.4 Turbo codes p. 1 Overview of Turbo Codes The Turbo code concept was first introduced by C. Berrou in 1993. The name was derived from an iterative decoding algorithm used to decode these codes
More informationErgebnisse der Mathematik und ihrer Grenzgebiete
Ergebnisse der Mathematik und ihrer Grenzgebiete 3. Folge. Band 26 A Series of Modem Surveys in Mathematics Editorial Board E. Bombieri, Princeton S. Feferman, Stanford M. Gromov, Bures-sur-Yvette H.W.
More informationAnalysis of Packet Loss for Compressed Video: Does Burst-Length Matter?
Analysis of Packet Loss for Compressed Video: Does Burst-Length Matter? Yi J. Liang 1, John G. Apostolopoulos, Bernd Girod 1 Mobile and Media Systems Laboratory HP Laboratories Palo Alto HPL-22-331 November
More informationEmbedding Multilevel Image Encryption in the LAR Codec
Embedding Multilevel Image Encryption in the LAR Codec Jean Motsch, Olivier Déforges, Marie Babel To cite this version: Jean Motsch, Olivier Déforges, Marie Babel. Embedding Multilevel Image Encryption
More informationTelevision and Teletext
Television and Teletext Macmillan New Electronics Series Series Editor: Paul A. Lynn Paul A. Lynn, Radar Systems A. F. Murray and H. M. Reekie, Integrated Circuit Design Dennis N. Pim, Television and Teletext
More informationApplication of Symbol Avoidance in Reed-Solomon Codes to Improve their Synchronization
Application of Symbol Avoidance in Reed-Solomon Codes to Improve their Synchronization Thokozani Shongwe Department of Electrical and Electronic Engineering Science, University of Johannesburg, P.O. Box
More informationPCM ENCODING PREPARATION... 2 PCM the PCM ENCODER module... 4
PCM ENCODING PREPARATION... 2 PCM... 2 PCM encoding... 2 the PCM ENCODER module... 4 front panel features... 4 the TIMS PCM time frame... 5 pre-calculations... 5 EXPERIMENT... 5 patching up... 6 quantizing
More informationTen Essays in the Development of Economic Thought. Ronald L. Meek Tyler Professor of Economics at the University of Leicester
SMITH, MARX, & AFTER SMITH, MARX, & AFTER Ten Essays in the Development of Economic Thought Ronald L. Meek Tyler Professor of Economics at the University of Leicester SPRINGER-SCIENCE+BUSINESS MEDIA. B.V.
More information2D ELEMENTARY CELLULAR AUTOMATA WITH FOUR NEIGHBORS
2D ELEMENTARY CELLULAR AUTOMATA WITH FOUR NEIGHBORS JOSÉ ANTÓNIO FREITAS Escola Secundária Caldas de Vizela, Rua Joaquim Costa Chicória 1, Caldas de Vizela, 4815-513 Vizela, Portugal RICARDO SEVERINO CIMA,
More information1 Introduction Steganography and Steganalysis as Empirical Sciences Objective and Approach Outline... 4
Contents 1 Introduction... 1 1.1 Steganography and Steganalysis as Empirical Sciences... 1 1.2 Objective and Approach... 2 1.3 Outline... 4 Part I Background and Advances in Theory 2 Principles of Modern
More informationTrends in Mathematics
Trends in Mathematics Trends in Mathematics is a series devoted to the publication of volumes arising from conferences and lecture series focusing on a particular topic from any area of mathematics. Its
More informationOn the Optimal Compressions in the Compress-and-Forward Relay Schemes
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 59, NO. 5, MAY 2013 2613 On the Optimal Compressions in the Compress--Forward Relay Schemes Xiugang Wu, Student Member, IEEE, Liang-Liang Xie, Senior Member,
More information'if it was so, it might be; and if it were so, it would be: but as it isn't, it ain't. That's logic'
Basic Digital Electronics 'Contrariwise,' continued Tweedledee, 'if it was so, it might be; and if it were so, it would be: but as it isn't, it ain't. That's logic' (Carroll: Alice Through the Looking
More informationDual Frame Video Encoding with Feedback
Video Encoding with Feedback Athanasios Leontaris and Pamela C. Cosman Department of Electrical and Computer Engineering University of California, San Diego, La Jolla, CA 92093-0407 Email: pcosman,aleontar
More informationSYSTEMATIC LOSSY ERROR PROTECTION OF VIDEO SIGNALS
SYSTEMATIC LOSSY ERROR PROTECTION OF VIDEO SIGNALS A DISSERTATION SUBMITTED TO THE DEPARTMENT OF ELECTRICAL ENGINEERING AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT
More informationINTERNATIONAL TELECOMMUNICATION UNION
INTERNATIONAL TELECOMMUNICATION UNION ITU-T G.975 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (10/2000) SERIES G: TRANSMISSION SYSTEMS AND MEDIA, DIGITAL SYSTEMS AND NETWORKS Digital sections and digital
More informationAnalysis of Different Pseudo Noise Sequences
Analysis of Different Pseudo Noise Sequences Alka Sawlikar, Manisha Sharma Abstract Pseudo noise (PN) sequences are widely used in digital communications and the theory involved has been treated extensively
More informationThe Sound of Silence
The Sound of Silence Burkhard Vogel The Sound of Silence Lowest-Noise RIAA Phono-Amps: Designer s Guide 123 Dipl.-Ing. Burkhard Vogel BUVOCON-Burkhard Vogel Consult GmbH 70180 Stuttgart, Germany ISBN 978-3-540-76883-8
More informationDecoder Assisted Channel Estimation and Frame Synchronization
University of Tennessee, Knoxville Trace: Tennessee Research and Creative Exchange University of Tennessee Honors Thesis Projects University of Tennessee Honors Program Spring 5-2001 Decoder Assisted Channel
More informationINSTRUCTION FOR AUTHORS
INSTRUCTION FOR AUTHORS 1 Manuscript submission Legal requirements Submission of a manuscript implies: that the work described has not been published before; that it is not under consideration for publication
More informationData Representation. signals can vary continuously across an infinite range of values e.g., frequencies on an old-fashioned radio with a dial
Data Representation 1 Analog vs. Digital there are two ways data can be stored electronically 1. analog signals represent data in a way that is analogous to real life signals can vary continuously across
More informationDesign and Implementation of Encoder and Decoder for SCCPM System Based on DSP Xuebao Wang1, a, Jun Gao1, b and Gaoqi Dou1, c
International Conference on Mechatronics Engineering and Information Technology (ICMEIT 2016) Design and Implementation of Encoder and Decoder for SCCPM System Based on DSP Xuebao Wang1, a, Jun Gao1, b
More informationDynamic bandwidth allocation scheme for multiple real-time VBR videos over ATM networks
Telecommunication Systems 15 (2000) 359 380 359 Dynamic bandwidth allocation scheme for multiple real-time VBR videos over ATM networks Chae Y. Lee a,heem.eun a and Seok J. Koh b a Department of Industrial
More informationDEPARTMENT OF ECONOMICS. Economics 620: The Senior Project
DEPARTMENT OF ECONOMICS Economics 620: The Senior Project The Senior Project is a significant piece of analysis that provides students with the experience of doing independent research under the guidance
More informationRobust Joint Source-Channel Coding for Image Transmission Over Wireless Channels
962 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 10, NO. 6, SEPTEMBER 2000 Robust Joint Source-Channel Coding for Image Transmission Over Wireless Channels Jianfei Cai and Chang
More informationThe H.26L Video Coding Project
The H.26L Video Coding Project New ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) standardization activity for video compression August 1999: 1 st test model (TML-1) December 2001: 10 th test model
More informationSuccessive Cancellation Decoding of Single Parity-Check Product Codes
Successive Cancellation Decoding of Single Parity-Check Product Codes Mustafa Cemil Coşkun, Gianluigi Liva, Alexandre Graell i Amat and Michael Lentmaier Institute of Communications and Navigation, German
More informationNew Results on QAM-Based 1000BASE-T Transceiver
New Results on QAM-Based 1000BASE-T Transceiver Oscar Agazzi, Mehdi Hatamian, Henry Samueli Broadcom Corp. 16251 Laguna Canyon Rd. Irvine, CA 92618 714-450-8700 Outline Transceiver parameters 3dB and 10dB
More informationT d. T db. T eb. Receving unit. Transmitting unit. Video decoder. Video output. Video encoder Encoder buffer. Video input. Channel Decoder buffer
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 7, NO. 5, MAY 999 Rate Control for Robust Video Transmission over Burst-Error Wireless Channels Chi-Yuan Hsu, Antonio Ortega, and Masoud Khansari
More informationITERATIVE DECODING FOR DIGITAL RECORDING SYSTEMS
2700 ITERATIVE DECODING FOR DIGITAL RECORDING SYSTEMS Jan Bajcsy, James A. Hunziker and Hisashi Kobayashi Department of Electrical Engineering Princeton University Princeton, NJ 08544 e-mail: bajcsy@ee.princeton.edu,
More informationConstant Bit Rate for Video Streaming Over Packet Switching Networks
International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Constant Bit Rate for Video Streaming Over Packet Switching Networks Mr. S. P.V Subba rao 1, Y. Renuka Devi 2 Associate professor
More informationAmerican Film Satire in the 1990s
American Film Satire in the 1990s American Film Satire in the 1990s Hollywood Subversion Johan Nilsson AMERICAN FILM SATIRE IN THE 1990S Copyright Johan Nilsson, 2013. Softcover reprint of the hardcover
More informationTransmission System for ISDB-S
Transmission System for ISDB-S HISAKAZU KATOH, SENIOR MEMBER, IEEE Invited Paper Broadcasting satellite (BS) digital broadcasting of HDTV in Japan is laid down by the ISDB-S international standard. Since
More informationHidden Markov Model based dance recognition
Hidden Markov Model based dance recognition Dragutin Hrenek, Nenad Mikša, Robert Perica, Pavle Prentašić and Boris Trubić University of Zagreb, Faculty of Electrical Engineering and Computing Unska 3,
More informationQuantum Theory and Local Causality
SPRINGER BRIEFS IN PHILOSOPHY Gábor Hofer-Szabó Péter Vecsernyés Quantum Theory and Local Causality SpringerBriefs in Philosophy SpringerBriefs present concise summaries of cutting-edge research and practical
More informationHANDBOOK OF RECORDING ENGINEERING
HANDBOOK OF RECORDING ENGINEERING HANDBOOK OF RECORDING ENGINEERING John Eargle Inm51 VAN NOSTRAND REINHOLD COMPANY ~ New York ISBN 978-94-010-9368-2 ISBN 978-94-010-9366-8 (ebook) 001 10.1007/978-94-010-9366-8
More informationModeling and Evaluating Feedback-Based Error Control for Video Transfer
Modeling and Evaluating Feedback-Based Error Control for Video Transfer by Yubing Wang A Dissertation Submitted to the Faculty of the WORCESTER POLYTECHNIC INSTITUTE In partial fulfillment of the Requirements
More informationPACKET-SWITCHED networks have become ubiquitous
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 13, NO. 7, JULY 2004 885 Video Compression for Lossy Packet Networks With Mode Switching and a Dual-Frame Buffer Athanasios Leontaris, Student Member, IEEE,
More informationCHAPTER 8 CONCLUSION AND FUTURE SCOPE
124 CHAPTER 8 CONCLUSION AND FUTURE SCOPE Data hiding is becoming one of the most rapidly advancing techniques the field of research especially with increase in technological advancements in internet and
More informationBER MEASUREMENT IN THE NOISY CHANNEL
BER MEASUREMENT IN THE NOISY CHANNEL PREPARATION... 2 overview... 2 the basic system... 3 a more detailed description... 4 theoretical predictions... 5 EXPERIMENT... 6 the ERROR COUNTING UTILITIES module...
More information