Gaming the Metrics


Book Description

How the increasing reliance on metrics to evaluate scholarly publications has produced new forms of academic fraud and misconduct. The traditional academic imperative to “publish or perish” is increasingly coupled with the newer necessity of “impact or perish”—the requirement that a publication have “impact,” as measured by a variety of metrics, including citations, views, and downloads. Gaming the Metrics examines how the increasing reliance on metrics to evaluate scholarly publications has produced radically new forms of academic fraud and misconduct. The contributors show that the metrics-based “audit culture” has changed the ecology of research, fostering the gaming and manipulation of quantitative indicators, which lead to the invention of such novel forms of misconduct as citation rings and variously rigged peer reviews. The chapters, written by both scholars and those in the trenches of academic publication, provide a map of academic fraud and misconduct today. They consider such topics as the shortcomings of metrics, the gaming of impact factors, the emergence of so-called predatory journals, the “salami slicing” of scientific findings, the rigging of global university rankings, and the creation of new watchdogs and forensic practices.




Game Analytics


Book Description

Developing a successful game in today’s market is a challenging endeavor. Thousands of titles are published yearly, all competing for players’ time and attention. Game analytics has emerged in the past few years as one of the main resources for ensuring game quality, maximizing success, understanding player behavior and enhancing the quality of the player experience. It has led to a paradigm shift in the development and design strategies of digital games, bringing data-driven intelligence practices into the fray for informing decision making at operational, tactical and strategic levels. Game Analytics - Maximizing the Value of Player Data is the first book on the topic of game analytics; the process of discovering and communicating patterns in data towards evaluating and driving action, improving performance and solving problems in game development and game research. Written by over 50 international experts from industry and research, it covers a comprehensive range of topics across more than 30 chapters, providing an in-depth discussion of game analytics and its practical applications. Topics covered include monetization strategies, design of telemetry systems, analytics for iterative production, game data mining and big data in game development, spatial analytics, visualization and reporting of analysis, player behavior analysis, quantitative user testing and game user research. This state-of-the-art volume is an essential source of reference for game developers and researchers. Key takeaways include: Thorough introduction to game analytics; covering analytics applied to data on players, processes and performance throughout the game lifecycle. In-depth coverage and advice on setting up analytics systems and developing good practices for integrating analytics in game-development and -management. Contributions by leading researchers and experienced professionals from the industry, including Ubisoft, Sony, EA, Bioware, Square Enix, THQ, Volition, and PlayableGames. Interviews with experienced industry professionals on how they use analytics to create hit games.




The Tyranny of Metrics


Book Description

How the obsession with quantifying human performance threatens business, medicine, education, government—and the quality of our lives Today, organizations of all kinds are ruled by the belief that the path to success is quantifying human performance, publicizing the results, and dividing up the rewards based on the numbers. But in our zeal to instill the evaluation process with scientific rigor, we've gone from measuring performance to fixating on measuring itself—and this tyranny of metrics now threatens the quality of our organizations and lives. In this brief, accessible, and powerful book, Jerry Muller uncovers the damage metrics are causing and shows how we can begin to fix the problem. Filled with examples from business, medicine, education, government, and other fields, the book explains why paying for measured performance doesn't work, why surgical scorecards may increase deaths, and much more. But Muller also shows that, when used as a complement to judgment based on personal experience, metrics can be beneficial, and he includes an invaluable checklist of when and how to use them. The result is an essential corrective to a harmful trend that increasingly affects us all.




Games User Research


Book Description

Games live and die commercially on the player experience. Games User Research is collectively the way we optimise the quality of the user experience (UX) in games, working with all aspects of a game from the mechanics and interface, visuals and art, interaction and progression, making sure every element works in concert and supports the game UX. This means that Games User Research is essential and integral to the production of games and to shape the experience of players. Today, Games User Research stands as the primary pathway to understanding players and how to design, build, and launch games that provide the right game UX. Until now, the knowledge in Games User Research and Game UX has been fragmented and there were no comprehensive, authoritative resources available. This book bridges the current gap of knowledge in Games User Research, building the go-to resource for everyone working with players and games or other interactive entertainment products. It is accessible to those new to Games User Research, while being deeply comprehensive and insightful for even hardened veterans of the game industry. In this book, dozens of veterans share their wisdom and best practices on how to plan user research, obtain the actionable insights from users, conduct user-centred testing, which methods to use when, how platforms influence user research practices, and much, much more.




The Psychology of Video Games


Book Description

What impact can video games have on us as players? How does psychology influence video game creation? Why do some games become cultural phenomena? The Psychology of Video Games introduces the curious reader to the relationship between psychology and video games from the perspective of both game makers and players. Assuming no specialist knowledge, this concise, approachable guide is a starter book for anyone intrigued by what makes video games engaging and what is their psychological impact on gamers. It digests the research exploring the benefits gaming can have on players in relation to education and healthcare, considers the concerns over potential negative impacts such as pathological gaming, and concludes with some ethics considerations. With gaming being one of the most popular forms of entertainment today, The Psychology of Video Games shows the importance of understanding the human brain and its mental processes to foster ethical and inclusive video games.




Escape Velocity: Better Metrics for Agile Teams


Book Description

Velocity is the most commonly used metric in agile software delivery. It is also perhaps the least effective metrics in agile software delivery. In "Escape Velocity", Doc Norton walks the reader through common issues with metrics and how to avoid them, altermative metrics that not only help agile teams perform better, but enable them to continuously improve, and techniques for forecasting that vastly outperform the use of velocity. In a quirky, casual, and information dense style, Doc Norton makes the topic of tracking data entertaining and shows us how to be more effective in the pursuit of excellent software.




Stealth Assessment


Book Description

An approach to performance-based assessments that embeds assessments in digital games in order to measure how students are progressing toward targeted goals. To succeed in today's interconnected and complex world, workers need to be able to think systemically, creatively, and critically. Equipping K-16 students with these twenty-first-century competencies requires new thinking not only about what should be taught in school but also about how to develop valid assessments to measure and support these competencies. In Stealth Assessment, Valerie Shute and Matthew Ventura investigate an approach that embeds performance-based assessments in digital games. They argue that using well-designed games as vehicles to assess and support learning will help combat students' growing disengagement from school, provide dynamic and ongoing measures of learning processes and outcomes, and offer students opportunities to apply such complex competencies as creativity, problem solving, persistence, and collaboration. Embedding assessments within games provides a way to monitor players' progress toward targeted competencies and to use that information to support learning. Shute and Ventura discuss problems with such traditional assessment methods as multiple-choice questions, review evidence relating to digital games and learning, and illustrate the stealth-assessment approach with a set of assessments they are developing and embedding in the digital game Newton's Playground. These stealth assessments are intended to measure levels of creativity, persistence, and conceptual understanding of Newtonian physics during game play. Finally, they consider future research directions related to stealth assessment in education.




Gaming Representation


Book Description

Gaming Representation' offers a timely and interdisciplinary call for greater inclusivity in video games. The issue of equality transcends the current focus in the field of Game Studies on code, materiality, and platforms. Journalists and bloggers have begun to hold the digital game industry and culture accountable for the discrimination routinely endured by female gamers, queer gamers, and gamers of color. Video game developers are responding to these critiques, but scholarly discussion of representation in games has lagged behind. Contributors to this volume examine portrayals of race, gender, and sexuality in a range of games, from casuals like Diner Dash, to indies like Journey and The Binding of Isaac, to mainstream games from the Grand Theft Auto, BioShock, Spec Ops, The Last of Us, and Max Payne franchises. Arguing that representation and identity function as systems in games that share a stronger connection to code and platforms than it may first appear, 'Gaming Representation' pushes gaming scholarship to new levels of inquiry, theorizing, and imagination.




Game Feel


Book Description

"Game Feel" exposes "feel" as a hidden language in game design that no one has fully articulated yet. The language could be compared to the building blocks of music (time signatures, chord progressions, verse) - no matter the instruments, style or time period - these building blocks come into play. Feel and sensation are similar building blocks whe




Measuring What Matters Most


Book Description

An argument that choice-based, process-oriented educational assessments are more effective than static assessments of fact retrieval. If a fundamental goal of education is to prepare students to act independently in the world--in other words, to make good choices--an ideal educational assessment would measure how well we are preparing students to do so. Current assessments, however, focus almost exclusively on how much knowledge students have accrued and can retrieve. In Measuring What Matters Most, Daniel Schwartz and Dylan Arena argue that choice should be the interpretive framework within which learning assessments are organized. Digital technologies, they suggest, make this possible; interactive assessments can evaluate students in a context of choosing whether, what, how, and when to learn. Schwartz and Arena view choice not as an instructional ingredient to improve learning but as the outcome of learning. Because assessments shape public perception about what is useful and valued in education, choice-based assessments would provide a powerful lever in this reorientation in how people think about learning. Schwartz and Arena consider both theoretical and practical matters. They provide an anchoring example of a computerized, choice-based assessment, argue that knowledge-based assessments are a mismatch for our educational aims, offer concrete examples of choice-based assessments that reveal what knowledge-based assessments cannot, and analyze the practice of designing assessments. Because high variability leads to innovation, they suggest democratizing assessment design to generate as many instances as possible. Finally, they consider the most difficult aspect of assessment: fairness. Choice-based assessments, they argue, shed helpful light on fairness considerations.