Practical Statistics for Data Scientists


Book Description

Statistical methods are a key part of of data science, yet very few data scientists have any formal statistics training. Courses and books on basic statistics rarely cover the topic from a data science perspective. This practical guide explains how to apply various statistical methods to data science, tells you how to avoid their misuse, and gives you advice on what's important and what's not. Many data science resources incorporate statistical methods but lack a deeper statistical perspective. If you’re familiar with the R programming language, and have some exposure to statistics, this quick reference bridges the gap in an accessible, readable format. With this book, you’ll learn: Why exploratory data analysis is a key preliminary step in data science How random sampling can reduce bias and yield a higher quality dataset, even with big data How the principles of experimental design yield definitive answers to questions How to use regression to estimate outcomes and detect anomalies Key classification techniques for predicting which categories a record belongs to Statistical machine learning methods that “learn” from data Unsupervised learning methods for extracting meaning from unlabeled data




Linear Regression Analysis


Book Description

"This volume presents in detail the fundamental theories of linear regression analysis and diagnosis, as well as the relevant statistical computing techniques so that readers are able to actually model the data using the techniques described in the book. This book is suitable for graduate students who are either majoring in statistics/biostatistics or using linear regression analysis substantially in their subject area." --Book Jacket.




Statistical Inference as Severe Testing


Book Description

Mounting failures of replication in social and biological sciences give a new urgency to critically appraising proposed reforms. This book pulls back the cover on disagreements between experts charged with restoring integrity to science. It denies two pervasive views of the role of probability in inference: to assign degrees of belief, and to control error rates in a long run. If statistical consumers are unaware of assumptions behind rival evidence reforms, they can't scrutinize the consequences that affect them (in personalized medicine, psychology, etc.). The book sets sail with a simple tool: if little has been done to rule out flaws in inferring a claim, then it has not passed a severe test. Many methods advocated by data experts do not stand up to severe scrutiny and are in tension with successful strategies for blocking or accounting for cherry picking and selective reporting. Through a series of excursions and exhibits, the philosophy and history of inductive inference come alive. Philosophical tools are put to work to solve problems about science and pseudoscience, induction and falsification.




Empirical Asset Pricing


Book Description

An introduction to the theory and methods of empirical asset pricing, integrating classical foundations with recent developments. This book offers a comprehensive advanced introduction to asset pricing, the study of models for the prices and returns of various securities. The focus is empirical, emphasizing how the models relate to the data. The book offers a uniquely integrated treatment, combining classical foundations with more recent developments in the literature and relating some of the material to applications in investment management. It covers the theory of empirical asset pricing, the main empirical methods, and a range of applied topics. The book introduces the theory of empirical asset pricing through three main paradigms: mean variance analysis, stochastic discount factors, and beta pricing models. It describes empirical methods, beginning with the generalized method of moments (GMM) and viewing other methods as special cases of GMM; offers a comprehensive review of fund performance evaluation; and presents selected applied topics, including a substantial chapter on predictability in asset markets that covers predicting the level of returns, volatility and higher moments, and predicting cross-sectional differences in returns. Other chapters cover production-based asset pricing, long-run risk models, the Campbell-Shiller approximation, the debate on covariance versus characteristics, and the relation of volatility to the cross-section of stock returns. An extensive reference section captures the current state of the field. The book is intended for use by graduate students in finance and economics; it can also serve as a reference for professionals.




Exploring Modern Regression Methods Using SAS


Book Description

This special collection of SAS Global Forum papers demonstrates new and enhanced capabilities and applications of lesser-known SAS/STAT and SAS Viya procedures for regression models. The goal here is to raise awareness of current valuable SAS/STAT content of which the user may not be aware. Also available free as a PDF from sas.com/books.




Joint Species Distribution Modelling


Book Description

A comprehensive account of joint species distribution modelling, covering statistical analyses in light of modern community ecology theory.




Bayesian Structural Equation Modeling


Book Description

This book offers researchers a systematic and accessible introduction to using a Bayesian framework in structural equation modeling (SEM). Stand-alone chapters on each SEM model clearly explain the Bayesian form of the model and walk the reader through implementation. Engaging worked-through examples from diverse social science subfields illustrate the various modeling techniques, highlighting statistical or estimation problems that are likely to arise and describing potential solutions. For each model, instructions are provided for writing up findings for publication, including annotated sample data analysis plans and results sections. Other user-friendly features in every chapter include "Major Take-Home Points," notation glossaries, annotated suggestions for further reading, and sample code in both Mplus and R. The companion website (www.guilford.com/depaoli-materials) supplies data sets; annotated code for implementation in both Mplus and R, so that users can work within their preferred platform; and output for all of the book’s examples.




The Solution Path of the Generalized Lasso


Book Description

We present a path algorithm for the generalized lasso problem. This problem penalizes the l1 norm of a matrix D times the coefficient vector, and has a wide range of applications, dictated by the choice of D. Our algorithm is based on solving the dual of the generalized lasso, which facilitates computation and conceptual understanding of the path. For D=I (the usual lasso), we draw a connection between our approach and the well-known LARS algorithm. For an arbitrary D, we derive an unbiased estimate of the degrees of freedom of the generalized lasso fit. This estimate turns out to be quite intuitive in many applications.




Statistical Learning with Sparsity


Book Description

Discover New Methods for Dealing with High-Dimensional DataA sparse statistical model has only a small number of nonzero parameters or weights; therefore, it is much easier to estimate and interpret than a dense model. Statistical Learning with Sparsity: The Lasso and Generalizations presents methods that exploit sparsity to help recover the underl




Applied Predictive Modeling


Book Description

Applied Predictive Modeling covers the overall predictive modeling process, beginning with the crucial steps of data preprocessing, data splitting and foundations of model tuning. The text then provides intuitive explanations of numerous common and modern regression and classification techniques, always with an emphasis on illustrating and solving real data problems. The text illustrates all parts of the modeling process through many hands-on, real-life examples, and every chapter contains extensive R code for each step of the process. This multi-purpose text can be used as an introduction to predictive models and the overall modeling process, a practitioner’s reference handbook, or as a text for advanced undergraduate or graduate level predictive modeling courses. To that end, each chapter contains problem sets to help solidify the covered concepts and uses data available in the book’s R package. This text is intended for a broad audience as both an introduction to predictive models as well as a guide to applying them. Non-mathematical readers will appreciate the intuitive explanations of the techniques while an emphasis on problem-solving with real data across a wide variety of applications will aid practitioners who wish to extend their expertise. Readers should have knowledge of basic statistical ideas, such as correlation and linear regression analysis. While the text is biased against complex equations, a mathematical background is needed for advanced topics.