ELEN E6717x Information theory Lect: 2. 3 pts. Prerequisites: SIEO W3658 or a course in stochastic processes. Corequisites: ELEN E4815. Mutual information and entropy. The source coding theorem. The capacity of discrete memoryless channels and the noisy channel coding theorem. The rate distortion function. Discrete memoryless sources and single-letter distortion measures. Bhattacharya bounds, convolutional codes, and the Viterbi algorithm.