Information theory and cognition: A review

Research output: Contribution to journalReview article

5 Scopus citations

Abstract

We examine how information theory has been used to study cognition over the last seven decades. After an initial burst of activity in the 1950s, the backlash that followed stopped most work in this area. The last couple of decades has seen both a revival of interest, and a more firmly grounded, experimentally justified use of information theory. We can view cognition as the process of transforming perceptions into information-where we use information in the colloquial sense of the word. This last clarification is one of the problems we run into when trying to use information theoretic principles to understand or analyze cognition. Information theory is mathematical, while cognition is a subjective phenomenon. It is relatively easy to discern a subjective connection between cognition and information; it is a different matter altogether to apply the rigor of information theory to the process of cognition. In this paper, we will look at the many ways in which people have tried to alleviate this problem. These approaches range from narrowing the focus to only quantifiable aspects of cognition or borrowing conceptual machinery from information theory to address issues of cognition. We describe applications of information theory across a range of cognition research, from neural coding to cognitive control and predictive coding.

Original languageEnglish (US)
Article number706
JournalEntropy
Volume20
Issue number9
DOIs
StatePublished - Sep 14 2018

Keywords

  • Averagemutual information
  • Cognition
  • Information theory
  • Neuronal codes
  • Predictive coding

ASJC Scopus subject areas

  • Physics and Astronomy(all)

Fingerprint Dive into the research topics of 'Information theory and cognition: A review'. Together they form a unique fingerprint.

  • Cite this