Information Theory and Language

Information Theory and Language PDF Author: Łukasz Dębowski
Publisher: MDPI
ISBN: 3039360264
Category : Mathematics
Languages : en
Pages : 244

Get Book Here

Book Description
“Information Theory and Language” is a collection of 12 articles that appeared recently in Entropy as part of a Special Issue of the same title. These contributions represent state-of-the-art interdisciplinary research at the interface of information theory and language studies. They concern in particular: • Applications of information theoretic concepts such as Shannon and Rényi entropies, mutual information, and rate–distortion curves to the research of natural languages; • Mathematical work in information theory inspired by natural language phenomena, such as deriving moments of subword complexity or proving continuity of mutual information; • Empirical and theoretical investigation of quantitative laws of natural language such as Zipf’s law, Herdan’s law, and Menzerath–Altmann’s law; • Empirical and theoretical investigations of statistical language models, including recently developed neural language models, their entropies, and other parameters; • Standardizing language resources for statistical investigation of natural language; • Other topics concerning semantics, syntax, and critical phenomena. Whereas the traditional divide between probabilistic and formal approaches to human language, cultivated in the disjoint scholarships of natural sciences and humanities, has been blurred in recent years, this book can contribute to pointing out potential areas of future research cross-fertilization.

Information Theory and Language

Information Theory and Language PDF Author: Łukasz Dębowski
Publisher: MDPI
ISBN: 3039360264
Category : Mathematics
Languages : en
Pages : 244

Get Book Here

Book Description
“Information Theory and Language” is a collection of 12 articles that appeared recently in Entropy as part of a Special Issue of the same title. These contributions represent state-of-the-art interdisciplinary research at the interface of information theory and language studies. They concern in particular: • Applications of information theoretic concepts such as Shannon and Rényi entropies, mutual information, and rate–distortion curves to the research of natural languages; • Mathematical work in information theory inspired by natural language phenomena, such as deriving moments of subword complexity or proving continuity of mutual information; • Empirical and theoretical investigation of quantitative laws of natural language such as Zipf’s law, Herdan’s law, and Menzerath–Altmann’s law; • Empirical and theoretical investigations of statistical language models, including recently developed neural language models, their entropies, and other parameters; • Standardizing language resources for statistical investigation of natural language; • Other topics concerning semantics, syntax, and critical phenomena. Whereas the traditional divide between probabilistic and formal approaches to human language, cultivated in the disjoint scholarships of natural sciences and humanities, has been blurred in recent years, this book can contribute to pointing out potential areas of future research cross-fertilization.

A Theory of Language and Information

A Theory of Language and Information PDF Author: Zellig Sabbettai Harris
Publisher:
ISBN:
Category : Computers
Languages : en
Pages : 456

Get Book Here

Book Description
Written by one of the most respected figures in American linguistics, this book develops an approach to the analysis of language on a mathematical model. Harris presents a formal theory of language structure, in which syntax is characterized as an orderly system of departure from random combinings of sounds, words, and all the elements of language. He argues that the combining of words in a sentence constitutes a mathematical object, and that each departure from randomness is a contribution to the structure and meaning of a sentence. Discussing the differences in the structure and content of language, mathematics, and music, Harris shows that the use of language in a science constitutes a distinguishable sub-language. Remarkable and compelling, Harris's magnum opus will be considered the classical analysis of the structuring of information and development of language.

Theory of Language

Theory of Language PDF Author: Steven Weisler
Publisher: MIT Press
ISBN: 9780262731256
Category : Language Arts & Disciplines
Languages : en
Pages : 370

Get Book Here

Book Description
Along with coverage of phonics, phonology, morphology, semantics and syntax, the text covers more unconventional topics including language and culture, and language evolution."--BOOK JACKET.

The Psychology of Language

The Psychology of Language PDF Author: Trevor A. Harley
Publisher: Psychology Press
ISBN: 1317710029
Category : Psychology
Languages : en
Pages : 1083

Get Book Here

Book Description
This thorough revision and update of the popular second edition contains everything the student needs to know about the psychology of language: how we understand, produce, and store language.

The Logic of Information

The Logic of Information PDF Author: Luciano Floridi
Publisher: Oxford University Press
ISBN: 0192570277
Category : Mathematics
Languages : en
Pages : 224

Get Book Here

Book Description
Luciano Floridi presents an innovative approach to philosophy, conceived as conceptual design. He explores how we make, transform, refine, and improve the objects of our knowledge. His starting point is that reality provides the data, to be understood as constraining affordances, and we transform them into information, like semantic engines. Such transformation or repurposing is not equivalent to portraying, or picturing, or photographing, or photocopying anything. It is more like cooking: the dish does not represent the ingredients, it uses them to make something else out of them, yet the reality of the dish and its properties hugely depend on the reality and the properties of the ingredients. Models are not representations understood as pictures, but interpretations understood as data elaborations, of systems. Thus, he articulates and defends the thesis that knowledge is design and philosophy is the ultimate form of conceptual design. Although entirely independent of Floridi's previous books, The Philosophy of Information (OUP 2011) and The Ethics of Information (OUP 2013), The Logic of Information both complements the existing volumes and presents new work on the foundations of the philosophy of information.

A Theory of Predicates

A Theory of Predicates PDF Author: Farrell Ackerman
Publisher: Stanford Univ Center for the Study
ISBN: 9781575860862
Category : Language Arts & Disciplines
Languages : en
Pages : 402

Get Book Here

Book Description
When studying linguistics, it is commonplace to find that information packaged into a single word in one language is expressed by several independent words in another language. This observation raises an important question: how can linguistics research represent what is the same among languages while accounting for the obvious differences between them? In this work, two linguists-Farrell Ackerman and Gert Webelhuth-from different theoretical paradigms develop a new general theory of natural language predicates. This theory is capable of addressing a broad range of issues concerning (complex) predicates, many of which remain unresolved in previous theoretical proposals. The book focuses on cross-linguistically recurring patterns of predicate formation. It also provides a detailed implementation of Ackerman and Webelhuth's theory for German tense-aspect, passive, causative, and verb-particle predicates. In addition, a discussion of the extension of these representative analyses to the same predicate construction in other languages is presented. Beyond providing a formalism for the analysis of language-particular predicates, the authors demonstrate how the basic theoretical mechanism they develop can be employed to explain universal tendencies of predicate formation.

Foundations of Logico-Linguistics

Foundations of Logico-Linguistics PDF Author: W.S. Cooper
Publisher: Springer Science & Business Media
ISBN: 9789027708762
Category : Language Arts & Disciplines
Languages : en
Pages : 276

Get Book Here

Book Description
In 1962 a mimeographed sheet of paper fell into my possession. It had been prepared by Ernest Adams of the Philosophy Department at Berkeley as a handout for a colloquim. Headed 'SOME FALLACIES OF FORMAL LOGIC' it simply listed eleven little pieces of reasoning, all in ordinary English, and all absurd. I still have the sheet, and quote a couple of the arguments here to give the idea. • If you throw switch S and switch T, the motor will start. There fore, either if you throw switch S the motor will start, or, if you throw switch T the motor will start . • It is not the case that if John passes history he will graduate. Therefore, John will pass history. The disconcerting thing about these inferences is, of course, that under the customary truth-functional interpretation of and, or, not, and if-then, they are supposed to be valid. What, if anything, is wrong? At first I was not disturbed by the examples. Having at that time consider able personal commitment to rationality in general and formal logic in par ticular, I felt it my duty and found myself easily able (or so I thought) to explain away most of them. But on reflection I had to admit that my expla nations had an ad hoc character, varying suspiciously from example to example.

Signs, Mind, and Reality

Signs, Mind, and Reality PDF Author: Sebastian Shaumyan
Publisher: John Benjamins Publishing
ISBN: 9027252017
Category : Language Arts & Disciplines
Languages : en
Pages : 345

Get Book Here

Book Description
The book presents a new science of semiotic linguistics. The goal of semiotic linguistics is to discover what characterizes language as an intermediary between the mind and reality so that language creates the picture of reality we perceive. The cornerstone of semiotic linguistics is the discovery and resolution of language antinomies ­-contradictions between two apparently reasonable principles or laws. Language antinomies constitute the essence of language, and hence must be studied from both linguistic and philosophical points of view. The basic language antinomy which underlies all other antinomies is the antinomy between meaning and information. Both generative and classical linguistic theories are unaware of the need to distinguish between meaning and information. By confounding these notions they are unable to discover language antinomies and confine their research to naturalistic description of superficial language phenomena rather than the quest for the essence of language.(Series A)

A Theory of Language and Information : a Mathematical Approach

A Theory of Language and Information : a Mathematical Approach PDF Author: Zellig Harris
Publisher:
ISBN:
Category :
Languages : en
Pages : 428

Get Book Here

Book Description


Theory of Language

Theory of Language PDF Author: Karl Bühler
Publisher: John Benjamins Publishing
ISBN: 9027286868
Category : Philosophy
Languages : en
Pages : 618

Get Book Here

Book Description
Karl Bühler (1879–1963) was one of the leading theoreticians of language of the twentieth century. Although primarily a psychologist, Bühler devoted much of his attention to the study of language and language theory. His masterwork Sprachtheorie (1934) quickly gained recognition in the fields of linguistics, semiotics, the philosophy of language and the psychology of language. This new edition of the English translation of Bühler’s theory begins with a survey on ‘Bühler’s legacy’ for modern linguistics (Werner Abraham), followed by the Theory of Language, and finally with a special ‘Postscript: Twenty-five Years Later ...’ (Achim Eschbach). Bühler’s theory is divided into four parts. Part I discusses the four axioms or principles of language research, the most famous of which is the first, the organon model, the base of Bühler's instrumental view of language. Part II treats the role of indexicality in language and discusses deixis as one determinant of speech. Part III examines the symbolic field, dealing with context, onomatopoeia and the function of case. Part IV deals with the elements of language and their organization (syllabification, the definition of the word, metaphor, anaphora, etc).The text is accompanied by an Introduction (Achim Eschbach); Translator's preface (Donald Fraser Goodwin); Glossary of terms; and a Bibliography of cited works.