Summer Semester 2009/10
Summer Semester 2010/11
Summer Semester 2011/12
Information Theory and Coding TS2B100006
Course content: the emphasis is put on concept of information, models of sources of information, the entropy as a fundamental measure of information content, Shannon source coding theorem, (Huffman coding, arithmetic coding, LZW coding), elements of band signals coding, models of discrete and analog channel (conditional information, joint information and mutual information), capacity of a discrete channel, gaussian channel, Shannon theorem of a noisy channel, decision rules and its classification, introduction to channel coding (Hamming coding, cyclic coding, convolutional coding) the Viterbi decoding algorithm, turbo coding rules.
Learning outcomes: students develope skills for data preparing for transmission and receiving taking into account limitations of transmission media.
(in Polish) Rodzaj przedmiotu
Course coordinators
Bibliography
a) basic references:
2. Wesołowski K. Podstawy Cyfrowych Systemów Telekomunikacyjnych. WKŁ Warszawa 2003.
3. Dąbrowski A.: Podstawy transmisji cyfrowej. OWPW, Warszawa 1999.
4. Sayood K.: Kompresja Danych. Wprowadzenie. Wydawnictwo RM, Warszawa, 2002.
5. Łukasik Z.: Teoria Informacji i Sygnałów. Wydawnictwa Politechniki Radomskiej,1999.
b) supplementary references:
1. McKay D.: Information Theory, Inference, and Learning Algorithms. Cambridge University Press, 2003, available in an electronic way.