Studies in Language and Information


Book Description

"A new collection of John Perry's work celebrating his contributions to the philosophy of language"--




Language and Text


Book Description

Specialists in quantitative linguistics the world over have recourse to a solid and universal methodology. These days, their methods and mathematical models must also respond to new communication phenomena and the flood of data produced daily. While various disciplines (computer science, media science) have different ways of processing this onslaught of information, the linguistic approach is arguably the most relevant and effective. This book includes recent results from many renowned contemporary practitioners in the field. Our target audiences are academics, researchers, graduate students, and others involved in linguistics, digital humanities, and applied mathematics.




Encyclopaedia Britannica


Book Description

This eleventh edition was developed during the encyclopaedia's transition from a British to an American publication. Some of its articles were written by the best-known scholars of the time and it is considered to be a landmark encyclopaedia for scholarship and literary style.




Information Structure and Language Change


Book Description

The volume presents new approaches to explaining word order variation and change in the Germanic languages and thus relates to one of the most prominent and widely discussed topics in the theory of language change and diachronic syntax. The novelty of our approach consists in three main points. First of all, we aim at describing functional variety in the field of word order and verb placement in the early Germanic languages not as a result of language contact, but rather as a language-internal phenomenon related to stylistic and grammatical conditions in information packaging. Second, given that information structure is not directly accessible in texts from historical corpora that are available only in written form and bear no or little information on prosody and intonation, it presents various methods of retrieving information-structural categories in such texts. Third, it presents empirical studies on the relation between word order and information structure of the four main texts of the Old High German period and embeds these results in the wider picture of word order change in Germanic. The volume will be of interest to students of German, English, and general linguistics as well as to researchers interested in diachronic syntax, philology of Older German, language change, information structure, discourse semantics, language typology, computational linguistics, and corpus studies.




Information Sharing


Book Description

This book introduces the concept of information sharing as an area of cognitive science, defining it as the process by which speakers depend on "given" information to convey "new" information--an idea crucial to language engineering. Where previous work in information sharing was often fragmented between different disciplines, this volume brings together theoretical and applied work, and joins computational contributions with papers based on analyses of language corpora and on psycholinguistic experimentation.




Language and Power


Book Description

Routledge English Language Introductions cover core areas of language study and are one-stop resources for students. Assuming no prior knowledge, books in the series offer an accessible overview of the subject, with activities, study questions, sample analyses, commentaries and key readings – all in the same volume. The innovative and flexible ‘two-dimensional’ structure is built around four sections – introduction, development, exploration and extension – which offer self-contained stages for study. Each topic can also be read across these sections, enabling the reader to build gradually on the knowledge gained. Language and Power: offers a comprehensive survey of the ways in which language intersects and connects with the social, cultural and political aspects of power, provides a comprehensive introduction to the history of the field, and covers all the major approaches, theoretical concepts and methods of analysis in this important and developing area of academic study; covers all the ‘traditional’ topics, such as race, gender and institutional power, but also incorporates newer material from forensic discourse analysis, the discourse of new capitalism and the study of humour as power; includes readings from works by seminal figures in the field, such as Roger Fowler, Deborah Cameron and Teun van Dijk; uses real texts and examples throughout, including advertisements from cosmetics companies; newspaper articles and headlines; websites and internet media; and spoken dialogues such as a transcription from the Obama and McCain presidential debate; is accompanied by a supporting website that aims to challenge students at a more advanced level and features a complete four-unit chapter which includes activities, a reading and suggestions for further work. Language and Power will be essential reading for students studying English language and linguistics. Paul Simpson is Professor of English Language in the School of English at Queen’s University Belfast, UK, where he teaches and researches in stylistics, critical linguistics and related fields of study. Andrea Mayr is Lecturer in Modern English Language and Linguistics at Queen’s University Belfast, UK, where she teaches and researches in media discourse and in multimodal critical discourse analysis.




A Theory of Language and Information


Book Description

In this, his magnum opus, distinguished linguist Zellig Harris presents a formal theory of language structure, in which syntax is characterized as an orderly system of departures from random combinations of sounds, words, and indeed of all elements of language.




Information Theory and Language


Book Description

“Information Theory and Language” is a collection of 12 articles that appeared recently in Entropy as part of a Special Issue of the same title. These contributions represent state-of-the-art interdisciplinary research at the interface of information theory and language studies. They concern in particular: • Applications of information theoretic concepts such as Shannon and Rényi entropies, mutual information, and rate–distortion curves to the research of natural languages; • Mathematical work in information theory inspired by natural language phenomena, such as deriving moments of subword complexity or proving continuity of mutual information; • Empirical and theoretical investigation of quantitative laws of natural language such as Zipf’s law, Herdan’s law, and Menzerath–Altmann’s law; • Empirical and theoretical investigations of statistical language models, including recently developed neural language models, their entropies, and other parameters; • Standardizing language resources for statistical investigation of natural language; • Other topics concerning semantics, syntax, and critical phenomena. Whereas the traditional divide between probabilistic and formal approaches to human language, cultivated in the disjoint scholarships of natural sciences and humanities, has been blurred in recent years, this book can contribute to pointing out potential areas of future research cross-fertilization.




Information


Book Description

In this primer for the information age, von Baeyer presents a clear description of what information is; how concepts of its measurement, meaning, and transmission evolved; and what its ever-expanding presence portends for the future.




Language Modeling for Information Retrieval


Book Description

A statisticallanguage model, or more simply a language model, is a prob abilistic mechanism for generating text. Such adefinition is general enough to include an endless variety of schemes. However, a distinction should be made between generative models, which can in principle be used to synthesize artificial text, and discriminative techniques to classify text into predefined cat egories. The first statisticallanguage modeler was Claude Shannon. In exploring the application of his newly founded theory of information to human language, Shannon considered language as a statistical source, and measured how weH simple n-gram models predicted or, equivalently, compressed natural text. To do this, he estimated the entropy of English through experiments with human subjects, and also estimated the cross-entropy of the n-gram models on natural 1 text. The ability of language models to be quantitatively evaluated in tbis way is one of their important virtues. Of course, estimating the true entropy of language is an elusive goal, aiming at many moving targets, since language is so varied and evolves so quickly. Yet fifty years after Shannon's study, language models remain, by all measures, far from the Shannon entropy liInit in terms of their predictive power. However, tbis has not kept them from being useful for a variety of text processing tasks, and moreover can be viewed as encouragement that there is still great room for improvement in statisticallanguage modeling.