Information Theory

Information Theory is fundamental to several areas of knowledge within engineering, computer science and mathematics, as well as many other educational disciplines. Within electrical engineering, information theory is a prerequisite to several sub disciplines including communication systems, transmissions techniques, error control coding, estimation and digital signal processing. Information Theory will be a self-contained book, designed to be either a stand-alone or supplemental text for advanced undergraduates or beginning graduate students in electrical engineering, computer engineering or mathematics and applied physics. The book will also serve as a refresher or primer for graduate students who need a refresher on these basic concepts in order to succeed in advanced courses. The book begins with the historical evolution of information theory, then moves on to introduce the basic concepts of set theory, measurement theory, the axiomatic theory of probability, entropy concepts and information concepts, which are basic to a course on information theory. Appendices include Fourier transforms in one and two dimensions, and important formulas and inequalities. Worked examples and illustrations will clarify all of the theory presented throughout the book.