Computer and System Sciences, Information Theory, 7.5 credits
Please note that the literature can be changed/revised until:
• June 1 for a course that starts in the autumn semester
• November 15 for a course that starts in the spring semester
• April 1 for a course that starts in the summer
Print or save the syllabus as a PDF
You can easily print a syllabus from the website. Use the keyboard shortcut ctrl+p (Windows) or command+p (Mac). In the next step, you choose whether you want to print or save the course plan as a PDF.
Syllabus:
Data- och systemvetenskap, Informationsteori, 7,5 hp
Computer and System Sciences, Information Theory, 7.5 credits
General data
- Code: DVS022F
- Subject/Main field: Computer and System Sciences
- Cycle: Third cycle
- Credits: 7,5
- Answerable faculty: Faculty of Science, Technology and Media
- Answerable department: Department of Information and Communication Systems
- Approved: 2016-12-14
- Version valid from: 2016-06-02
Aim
The aim with the course is to provide a general introduction to the topic of information theory and applications within reliable and efficient communications- and storage systems. The students will get fundamental knowledge about limitations in data compression, storage and communication. A solid understanding of these concept is of high importance for researchers and practitioners in the areas of Data- and Telecommunications, as well as Signal processing.
Course objectives
After the course, the student should be able to:
- Describe general principles of information theory
- Explain fundamental concepts such as entropy, mutual information, capacity, compression, basic algebraic coding theory, and source coding.
- Formulate and prove the most fundamental coding theorems.
- Define source coding and channel coding problems for multi-terminal channels, and describe coding theorems for distributed compression, multiple access and broadcast.
- Explain how information theory and coding contributes to modern communications technology.
- Do research using tools from information theory.
- Apply techniques for efficient writing of mathematical text
- Oral and written presentations of individual and/or group work
Content
Course contents:
- Fundamental information theory: Entropy, AEP, etc.
- Source- and Channel Coding
- Multiple Access Channels
- Broadcast Channels
- Rate Distortion Theory
- Discrete Memoryless Channels
Entry requirements
A person meets the entry requirements for the course if he or she has been admitted to a third-cycle study programme and will be given credit for the course in that study programme.
(Äldre gymnasiebetyg)
Selection rules and procedures
The selection process is in accordance with the Higher Education Ordinance and the local order of admission.
Teaching form
- Lectures
- Assignments
- Practical tasks performed individually and / or collectively
- Oral presentations of completed tasks individually and / or collectively,
- Written reports of the tasks carried out individually and / or in groups.
The course may also be given as a self-study course.
Examination form
Examination is three parts: active participation in the course, assignments, and a project.
Grading system
Fail (U) or Pass (G)
Course reading
Required literature
- Author: T. Cover and J. Thomas
- Title: Elements of Information Theory
- Edition: 2
- Publisher: Wiley
- Comment: ISBN 0-471-24195-4
Reference literature
- Author: A. E. Gamal, and Y-H. Kim
- Title: Network Information Theory
- Publisher: Cambridge University Press
- Comment: ISBN 978-1-107-00873-1