Skip to main content

Vocabulary of natural language processing

Search from vocabulary

Concept information

NLP methods and tools > information theory

Preferred term

information theory  

Definition

  • The mathematical treatment of the concepts, parameters and rules governing the transmission of messages through communication systems. (Martignon, Information Theory, in International Encyclopedia of the Social & Behavioral Sciences, 2001)

Broader concept

Example

  • Information theory provides a useful tool for exploring variation and for quantifying the predictability/organization of patterns e.g. in morphological systems (Ackerman and Malouf 2013). (Gutierrez-Vasques, Bentz, Sozinova & Samardzic, 2021)
  • Information theory tells us that the presence of a given morpheme restricts the possibilities of the occurrence of morphemes to the left and right thus lowering the amount of bits needed to store its neighbors. (Cavar, Herring, Ikuta, Rodrigues & Schrementi, 2004)

In other languages

URI

http://data.loterre.fr/ark:/67375/8LP-DWVBMBKS-N

Download this concept:

RDF/XML TURTLE JSON-LD Created 4/24/24, last modified 4/25/24