Word Frequency Distributions


Book Description

This book is a comprehensive introduction to the statistical analysis of word frequency distributions, intended for computational linguists, corpus linguists, psycholinguists, and researchers in the field of quantitative stylistics. It aims to make these techniques more accessible for non-specialists, both theoretically, by means of a careful introduction to the underlying probabilistic and statistical concepts, and practically, by providing a program library implementing the main models for word frequency distributions.




Frequency of Use and the Organization of Language


Book Description

This volume collects three decades of articles by the distinguished linguist Joan Bybee. Her articles essentially argue for the importance off frequency of use as a factor in the analysis and explanation of language structure. Her work has been very influential for a broad range of researchers in linguistics, particularly in discourse analysis, corpus linguistics, phonology, phonetics, and historical linguistics.




Frequency in Language


Book Description

Re-examines frequency, entrenchment and salience, three foundational concepts in usage-based linguistics, through the prism of learning, memory, and attention.




Word Frequency Studies


Book Description

The present book finds and collects absolutely new aspects of word frequency. First, eminent characteristics (such as the h-point, first used in scientometrics, the k-, m-, and n-points) are introduced - it can be shown that the geometry of word frequency is fundamentally based on them. Furthermore, various indicators of text properties are proposed for the first time, such as thematic concentration, autosemantic text compactness, autosemantic density, etc. In detail, the autosemantic structure of a given text is evaluated by means of a graph representation and its properties (according to a problem from network research). Special emphasis is given to the part-of-speech differentiation, which plays a significant role in stylistics. On the basis of a general theory, which has been developed especially for linguistic research, problems of the frequency structure of texts with respect to word occurrence are investigated and discussed in detail. Methodologically, specific reference is made to synergetic linguistics, including some exemplary analyses, showing that there are points of contact with this field. A separate chapter is dedicated to within-sentence word position; this issue considers grammar as well as language genesis; another chapter is dedicated to the type-token ratio, discussing all established methods and their relevance for word frequency analysis. All methods presented in the book are statistically tested; to this end, some new tests have been developed. All procedures and calculations are conducted for 20 languages, ranging from Polynesia, Indonesia, India, and Europe to a North American Indian language. The broad distribution of the data and texts from all genres allows generalizations with respect to language typology.




Frequency Analysis


Book Description




Frequency and the Emergence of Linguistic Structure


Book Description

A mainstay of functional linguistics has been the claim that linguistic elements and patterns that are frequently used in discourse become conventionalized as grammar. This book addresses the two issues that are basic to this claim: first, the question of what types of elements are frequently used in discourse and second, the question of how frequency of use affects cognitive representations. Reporting on evidence from natural conversation, diachronic change, variability, child language acquisition and psycholinguistic experimentation the original articles in this book support two major principles. First, the content of people’s interactions consists of a preponderance of subjective, evaluative statements, dominated by the use of pronouns, copulas and intransitive clauses. Second, the frequency with which certain items and strings of items are used has a profound influence on the way language is broken up into chunks in memory storage, the way such chunks are related to other stored material and the ease with which they are accessed to produce new utterances.







Text Mining with R


Book Description

Chapter 7. Case Study : Comparing Twitter Archives; Getting the Data and Distribution of Tweets; Word Frequencies; Comparing Word Usage; Changes in Word Use; Favorites and Retweets; Summary; Chapter 8. Case Study : Mining NASA Metadata; How Data Is Organized at NASA; Wrangling and Tidying the Data; Some Initial Simple Exploration; Word Co-ocurrences and Correlations; Networks of Description and Title Words; Networks of Keywords; Calculating tf-idf for the Description Fields; What Is tf-idf for the Description Field Words?; Connecting Description Fields to Keywords; Topic Modeling.




Foundations of Time-Frequency Analysis


Book Description

Time-frequency analysis is a modern branch of harmonic analysis. It com prises all those parts of mathematics and its applications that use the struc ture of translations and modulations (or time-frequency shifts) for the anal ysis of functions and operators. Time-frequency analysis is a form of local Fourier analysis that treats time and frequency simultaneously and sym metrically. My goal is a systematic exposition of the foundations of time-frequency analysis, whence the title of the book. The topics range from the elemen tary theory of the short-time Fourier transform and classical results about the Wigner distribution via the recent theory of Gabor frames to quantita tive methods in time-frequency analysis and the theory of pseudodifferential operators. This book is motivated by applications in signal analysis and quantum mechanics, but it is not about these applications. The main ori entation is toward the detailed mathematical investigation of the rich and elegant structures underlying time-frequency analysis. Time-frequency analysis originates in the early development of quantum mechanics by H. Weyl, E. Wigner, and J. von Neumann around 1930, and in the theoretical foundation of information theory and signal analysis by D.