ECE 7005
Transcript Abbreviation:
Information Theory
Course Description:
Mathematical models for channels and sources: entropy, information, data compression, channel capacity, Shannon's theorems, rate distortion theory.
Course Levels:
Graduate (5000-8000 level)
Designation:
Elective
General Education Course:
(N/A)
Cross-Listings:
(N/A)
Credit Hours (Minimum if “Range”selected):
3.00
Max Credit Hours:
3.00
Select if Repeatable:
Off
Maximum Repeatable Credits:
(N/A)
Total Completions Allowed:
(N/A)
Allow Multiple Enrollments in Term:
No
Course Length:
14 weeks (autumn or spring)
12 weeks (summer only)
Off Campus:
Never
Campus Location:
Columbus
Instruction Modes:
In Person (75-100% campus; 0-24% online)
Prerequisites and Co-requisites:
Prereq: 6001 (804).
Electronically Enforced:
No
Exclusions:
Not open to students with credit for 801.02.
Course Goals / Objectives:
Introduce information theory, the mathematical theory of communication
Use entropy as a measure of information
Learn information theoretic principles and literature for application in MS and PhD research
Check if concurrence sought:
No
Contact Hours:
| Topic | LEC | REC out-of-class | REC in-class | Weekly LAB out-of-class | Weekly LAB in-class |
|---|---|---|---|---|---|
| Entropy and mutual information | 6.0 | 0.0 | 0 | 0.0 | 0 |
| Asymptotic equipartition principle | 3.0 | 0.0 | 0 | 0.0 | 0 |
| Entropy rate | 3.0 | 0.0 | 0 | 0.0 | 0 |
| Data compression and discrete sources | 5.0 | 0.0 | 0 | 0.0 | 0 |
| Channel capacity | 5.0 | 0.0 | 0 | 0.0 | 0 |
| Differential entropy | 3.0 | 0.0 | 0 | 0.0 | 0 |
| Gaussian channels | 5.0 | 0.0 | 0 | 0.0 | 0 |
| Rate distortion theory | 6.0 | 0.0 | 0 | 0.0 | 0 |
| Total | 36 | 0 | 0 | 0 | 0 |
Grading Plan:
Letter Grade
Course Components:
Lecture
Grade Roster Component:
Lecture
Credit by Exam (EM):
No
Grades Breakdown:
| Aspect | Percent |
|---|---|
| Problem Sets | 15% |
| Midterm exams (2) | 35% |
| Final Exam | 50% |
Representative Textbooks and Other Course Materials:
| Title | Author | Year |
|---|---|---|
| Elements of Information Theory | Cover & Thomas |
ABET-CAC Criterion 3 Outcomes:
(N/A)
ABET-ETAC Criterion 3 Outcomes:
(N/A)
ABET-EAC Criterion 3 Outcomes:
(N/A)
Embedded Literacies Info: