Multimodal Semiotics


Book Description

This volume presents an overview of new developments and applications of social semiotic theory. Pioneered by M.A.K. Halliday, social semiotic theory sees meaning as created through the interaction of texts (including writing, images, sound and space) within a given context. Divided into five sections, the contributors use social semiotic theory to analyse a range of contexts, including the classroom, the museum and cinema. The case studies show the range and scope of this method of analysis, and include: the school curriculum; literacy; print media; online resources; film; and advertising. Multimodal Semiotics will be of interest to academics researching social semiotic theory, systemic functional linguistics and applied linguistics.




Multimodality


Book Description

Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.




Multimodal Semiotics and Rhetoric in Videogames


Book Description

This book uses a wide range of games as examples to demonstrate the medium's various forms of expression at work, including audio, visual, textual, haptic, and procedural modes, with a particular focus on the procedural form, which emphasizes processes and causal relationships, to better showcase its link with meaning-making. The second half of




Multimodal Communication


Book Description

This book draws on visual data, ranging from advertisements to postage stamps to digital personal photography, to offer a complex interpretation of the different social functions realised by these texts as semiotic artefacts. Framed within the media environment of the city of Hong Kong, the study demonstrates the importance of social context to meaning making and social semiotic multimodal analysis. This book will be of interest to readers in the arts, humanities and social sciences, particularly within the fields of semiotics, visual studies, design studies, media and cultural studies, anthropology and sociology.




Advancing Multimodal and Critical Discourse Studies


Book Description

As a founder and leading figure in multimodality and social semiotics, Theo van Leuween has made significant contributions to a variety of research fields, including discourse analysis, sociolinguistics, communication and media studies, education, and design. In celebration of his illustrious research career, this volume brings together a group of leading and emerging scholars in these fields to review, explore and advance two central research agendas set out by van Leeuwen: the categorisation of the meaning potential of various semiotic resources and the examination of their uses in different forms of communication, and the critical analysis of the interaction between semiotic forms, norms and technology in discursive practices. Through 11 cutting-edge research papers and an experimental visual essay, the book investigates a broad range of semiotic resources including touch, sound, image, texture, and discursive practices such as community currency, fitness regime, film scoring, and commodity upcycling. The book showcases how social semiotics and multimodality can provide insights into the burning issues of the day, such as global neoliberalism, terrorism, consumerism, and immigration.




Multimodality, Learning and Communication


Book Description

This state-of-the-art account of research and theorizing brings together multimodality, learning and communication through detailed analyses of signmakers and their meaning-making in museums, hospitals, schools and the home environment. By analyzing video recordings, photographs, screenshots and print materials, Jeff Bezemer and Gunther Kress go well beyond the comfortable domains of traditional sites of (social) semiotic and multimodal research. They steer away from spurious invention and naming of ever more new and exciting domains, focusing instead on fundamentals in assembling a set of tools for current tasks: namely, describing and analyzing learning and communication in the contemporary world as one integrated field. The theory outlined in the book is grounded in the findings of the authors’ wide-ranging empirical investigations. Each chapter evaluates the work that is being done and has been done, challenging accepted wisdom and standing much of it on its head. With extensive illustrations and many examples presented to show the reach and applicability of the theory, this book is essential reading for all those working in multimodality, semiotics, applied linguistics and related areas. Images from the book are also available to view online at www.routledge.com/9780415709620/




Multimodal Semiotics and Rhetoric in Videogames


Book Description

This book merges recent trends in game studies and multimodal studies to explore the relationship between the interaction between videogames’ different modes and the ways in which they inform meaning for both players and designers. The volume begins by laying the foundation for integrating the two disciplines, drawing upon social semiotic and discourse analytic traditions to examine their relationship with meaning in videogames. The book uses a wide range of games as examples to demonstrate the medium’s various forms of expression at work, including audio, visual, textual, haptic, and procedural modes, with a particular focus on the procedural form, which emphasizes processes and causal relationships, to better showcase its link with meaning-making. The second half of the book engages in a discussion of different multimodal configurations and user generated content to show how they contribute to the negotiation of meaning in the player experience, including their role in constructing and perpetuating persuasive messages and in driving interesting and unique player decisions in gameplay. Making the case for the benefits of multimodal approaches to game studies, this volume is key reading for students and researchers in multimodal studies, game studies, rhetoric, semiotics, and discourse analysis.




Multimodality


Book Description

Multimodality’s popularity as a semiotic approach has not resulted in a common voice yet. Its conceptual anchoring as well as its empirical applications often remain localized and disparate, and ideas of a theory of multimodality are heterogeneous and uncoordinated. For the field to move ahead, it must achieve a more mature status of reflection, mutual support, and interaction with regard to both past and future directions. The red thread across the disciplines reflected in this book is a common goal of capturing the mechanisms of synergetic knowledge construction and transmission using diverse forms of expressions, i.e., multimodality. The collection of chapters brought together in the book reflects both a diversity of disciplines and common interests and challenges, thereby establishing an excellent roadmap for the future. The contributions revisit and redefine theoretical concepts or empirical analyses, which are crucial to the study of multimodality from various perspectives, with a view towards evolving issues of multimodal analysis. With this, the book aims at repositioning the field as a well-grounded scientific discipline with significant implications for future communication research in many fields of study.




Multiculturalism as Multimodal Communication


Book Description

This highly readable book develops a numanistic, and specifically semiotic approach to multiculturalism. It reveals how semiotics provides fresh and valuable insights into multiculturalism: in contrast to the binary logic of dualistic philosophy, semiotic logic does not understand the value of truth in rigid terms of ‘true’ or ‘false’, ‘right’ or ‘wrong’ only. The value of truth resides in meaning, which is a dynamic, evolutionary phenomenon, rooted, nevertheless, in factuality. Drawing on recent developments in biosemiotics, the book presents a theoretical approach to multiculturalism, regarding the lives of people living in multicultural environments. Rather than analyzing political or economic phenomena, it offers a semiotic analysis of multiculturalism and discusses its educational implications. It also invites readers to regard learning as a phenomenon of ecological sign growth and to understand multiculturalism along the same lines. As such, it brings together the life and social sciences and the humanities in a unified perspective, in an approach fitting postmodernism. Developing a postmodern philosophy for contemporary non-experts, which allows distancing from political discourse in favor of a posthumanistic stand, where altruism is seen as an opportunity, not a threat, this book appeals to a wide readership, from scholars seeking state-of-the-art theories to general readers looking for a thought-provoking and enlightening read.




Music as Multimodal Discourse


Book Description

We communicate multimodally. Everyday communication involves not only words, but gestures, images, videos, sounds and of course, music. Music has traditionally been viewed as a separate object that we can isolate, discuss, perform and listen to. However, much of music's power lies in its use as multimodal communication. It is not just lyrics which lend songs their meaning, but images and musical sounds as well. The music industry, governments and artists have always relied on posters, films and album covers to enhance music's semiotic meaning. Music as Multimodal Discourse: Semiotics, Power and Protest considers musical sound as multimodal communication, examining the interacting meaning potential of sonic aspects such as rhythm, instrumentation, pitch, tonality, melody and their interrelationships with text, image and other modes, drawing upon, and extending the conceptual territory of social semiotics. In so doing, this book brings together research from scholars to explore questions around how we communicate through musical discourse, and in the discourses of music. Methods in this collection are drawn from Critical Discourse Analysis, Social Semiotics and Music Studies to expose both the function and semiotic potential of the various modes used in songs and other musical texts. These analyses reveal how each mode works in various contexts from around the world often articulating counter-hegemonic and subversive discourses of identity and belonging.