Perspectives on Multimodality


Book Description

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.




Perspectives on Multimodality


Book Description

This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.




Designing Learning with Embodied Teaching


Book Description

Teaching and learning involve more than just language. The teachers' use of gestures, the classroom spaces they occupy and the movements they make, as well as the tools they use, work together with language as a multimodal ensemble of meanings. Embodied teaching is about applying the understandings from multimodal communication to the classroom. It is about helping teachers recognise that the moves they make and the tools they use in the classroom are part of their pedagogy and contribute to the design of the students’ learning experience. In response to the changing profile and needs of learners in this digital age, pedagogic shifts are required. A shift is the evolving role of teachers from authority of knowledge to designers of learning. This book discusses how, using examples drawn from case studies, teachers can use corporeal resources and (digital) tools to design learning experiences for their students. It advances the argument that the study of the teachers' use of language, gestures, positioning, and movement in the classroom, from a multimodal perspective, can be productive. This book is intended for educational researchers and teacher practitioners, as well as curriculum specialists and policy makers. The central proposition is that as teachers develop a semiotic awareness of how their use of various meaning-making resources express their unique pedagogy they can use these multimodal resources aptly and fluently to design meaningful learning experiences. This book also presents a case for further research in educational semiotics to understand the embodied ways of meaning-making in the pedagogic context.




Multimodality


Book Description

Gunther Kress, a pioneer in the field of multimodality and the co-author of the bestselling Reading Images, produces a comprehensive theoretical framework for the study of the topic providing sample analyses and suggestions for further reading.




Multimodal Discourse Analysis


Book Description

This book brings together cutting-edge research on multimodal texts and the "discourses" generated through the interaction of two or more modes of communication, for example pictures of language, typography and layout, body movement and camera movement. The contributors collected within this volume use systemic functional linguistics to analyze how meaning is generated within a series of case studies. The result is a comprehensive survey of the ways in which enhanced meaning emerges through the interaction of more than one mode of communication. Multimodal Discourse Analysis will be useful to researchers interested in the application of systemic functional linguistics to media studies, discourse analysis and cognitive linguistics.




Multimodality


Book Description

This textbook provides the first foundational introduction to the practice of analysing multimodality, covering the full breadth of media and situations in which multimodality needs to be a concern. Readers learn via use cases how to approach any multimodal situation and to derive their own specifically tailored sets of methods for conducting and evaluating analyses. Extensive references and critical discussion of existing approaches from many disciplines and in each of the multimodal domains addressed are provided. The authors adopt a problem-oriented perspective throughout, showing how an appropriate foundation for understanding multimodality as a phenomenon can be used to derive strong methodological guidance for analysis as well as supporting the adoption and combination of appropriate theoretical tools. Theoretical positions found in the literature are consequently always related back to the purposes of analysis rather than being promoted as valuable in their own right. By these means the book establishes the necessary theoretical foundations to engage productively with today’s increasingly complex combinations of multimodal artefacts and performances of all kinds.




Multimodality


Book Description

Multimodality’s popularity as a semiotic approach has not resulted in a common voice yet. Its conceptual anchoring as well as its empirical applications often remain localized and disparate, and ideas of a theory of multimodality are heterogeneous and uncoordinated. For the field to move ahead, it must achieve a more mature status of reflection, mutual support, and interaction with regard to both past and future directions. The red thread across the disciplines reflected in this book is a common goal of capturing the mechanisms of synergetic knowledge construction and transmission using diverse forms of expressions, i.e., multimodality. The collection of chapters brought together in the book reflects both a diversity of disciplines and common interests and challenges, thereby establishing an excellent roadmap for the future. The contributions revisit and redefine theoretical concepts or empirical analyses, which are crucial to the study of multimodality from various perspectives, with a view towards evolving issues of multimodal analysis. With this, the book aims at repositioning the field as a well-grounded scientific discipline with significant implications for future communication research in many fields of study.




Analyzing Multimodality in Specialized Discourse Settings


Book Description

Contemporary society has witnessed radical changes in the field of communications in terms of how messages and meanings are disseminated. Digitalization and the Internet have signalled an exponential rise in the circulation of multimodal texts in which different semiotic resources are orchestrated together to construct meaning in all areas of social life, across languages and cultures, and in diverse specialized discourse domains. This has foregrounded the need to examine the semiotic functions, affordances, and issues at stake in a range of multimodal discourse forms, while simultaneously highlighting the importance of critical multimodal literacy in audiences and learners. This volume develops and extends pioneering research on the intersection between multimodality and specialized discourse. Eight newly commissioned studies offer innovative perspectives on multimodal research methodologies and applications in a variety of ESP (English for Specific Purposes) contexts for practitioners and scholars alike. The volume offers a glimpse at future directions in this dynamic and ever-evolving area of investigation focusing on the synergy between verbal and non-verbal modes of communication in the digital age. Each chapter explores an original area of application: academic, economic, scientific, marketing, legal, medical, political, and tourism. The contributors approach multimodality from a range of theoretical and methodological viewpoints including synchronic and diachronic corpus-based and corpus-aided studies, critical discourse analysis, and systemic functional linguistics. Analytical tools such as multimodal (critical) discourse analysis, multimodal transcription, and multimodal annotation software capable of representing the interplay of different semiotic modes - speech, intonation, direction of gaze, facial expressions, gesturing, and spatial positioning of interlocutors - are employed. The diversity of research strands contained in the volume illustrates just some of the vast areas of multimodal knowledge dissemination that are still unmapped. As a cornerstone of communication, multimodality needs exploring in all its facets. These contributions aim to further that cause.




Translating the Visual


Book Description

This book offers insights into the translation and adaptation of illustrated texts in an era in which visual texts are perceived as a dominant perceptual frame for interpreting social and cultural phenomena. Using source texts including illustrated books, comics, graphic novels and animated films, the authors analyze their translations and adaptations to address the works as multimodal entities, in which even the replacement of one component affects the entire whole. Interviews with the artists - writers, illustrators and animators - will shed more light on the observations. This volume’s unique focus on the visual mode and the impact of its replacement on the multimodal whole is a topic that has not attracted as much attention as the translation of the verbal component, and will appeal to students and researchers of translation and adaptation, popular culture, media and communication, and children’s literature alike.




Multimodality in English Language Learning


Book Description

This edited volume provides research-based knowledge on the use, production and assessment of multimodal texts in the teaching and learning of English as an Additional Language (EAL). The book reflects growing interest in research on EAL, with increasing numbers of learners of English worldwide and the growing relevance of EAL to numerous education systems. The volume examines different aspects of English from a multimodal perspective, showcasing empirical research from across five continents and all three levels of education. Applying frameworks based on Multimodal Social Semiotics and Systemic Functional Linguistics, chapters focus on the use and affordances of multimodal texts in pedagogy, literature, culture, text production, assessment and curriculum development connected to EAL. Directing attention to the significance of modes beyond speech and writing in EAL, the volume provides a wide range of perspectives and experiences that can be applied more widely and inspire other practices in the global and diverse field of EAL teaching, learning and assessment. This collection will be of interest to scholars in multimodality, language education, and teacher education.