Multimodal Analysis
analysis of expressive gesture in music and dance performances. In Gesture-Based Communication in Human-Computer Interaction, 2915, 357-358.
The article focuses on research concerning the analysis of expressive gesture from the
perspective of multimodal interaction and the development of systems of multimodal interaction by considering the role that non-verbal expressive gesture would play in the communication process. The multimodal analysis focuses mainly on dance and music because they provide a comprehensive emotional and expressive content.
The authors explained the involvement of auditory and visual gestures in demonstrating the expressive purpose of the performers. They tested the model of auditory and visual gestures by making a comparison of the performances with the ratings of audiences of the same dance and music performances. Other topics that students can get from the article include the definition of the expressive gesture, framework for multimodal analysis of expressive gesture in terms of the ability of performers to relay their emotions to the audience, and automated extraction of auditory and visual cues.
Dowling, R. G., Dowling, R., Reinke, D., National Cooperative Highway Research Program
(2008). Multimodal level of service analysis for urban streets. Washington, D. C. Transportation Research Board.
The authors highlighted the findings of a study on how the public can interpret the quality
of multimodal service offered by urban streets. The study focuses mainly on various factors that influence or affect the perception of various travelers when it comes to the level of service of urban streets, particularly the perceptions of automotive drivers, bicycle riders, bus riders, and pedestrians. The authors stressed the importance of using models of level of service in analyzing the benefits that urban travelers can get from context-focus street designs.
The book will help widen the knowledge of students in applying multimodal analysis to urban streets. It provides students with insights into the definition of urban streets and transits, techniques of analyzing the level of service for urban streets, and economic and safety aspects of level of service. Other topics covered in the book include the integration of four models of level of service in order to have the same level of service rating system and suggested level of service for bicycle riders, transit passengers, and pedestrians.
Foote, J., Boreczky, J., Girgensohn, A., Wilcox, L.(1998). An intelligent media browser using
automatic multimodal analysis. International Multimedia Conference. Proceedings of the
Sixth ACM International Conference on Multimedia, 375-380.
The article provides a way to automatically analyze multimedia using an intelligent browser. The automatic multimodal analysis allows users to have informed decisions on various interests in the field of media in order to avoid searching areas outside the scope their interest. The article provides explanation on two types of automatic multimodal analysis, the audio similarity to identify the speaker and the frame differences to detect shot. Recognition of gesture, motion, and face in the browsing scheme and the combination of audio and video analysis are integrated in the automatic multimodal analysis. The article can enhance the knowledge of students on automatic analysis of multimedia resources by providing various ways to make noisy and erroneous automatic estimates more applicable to the user. Some examples of multimedia resources include digital ink, closed captions, audio, video, and text annotations.
Kress, G. Van Leeuwen, T. (2001). Multimodal discourse the modes and media of
contemporary communication. Arnold, New York Oxford University Press.
The authors provided insights into the role that the communication theory will play in the era of interactive multimedia. They compared how the design thinking and production thinking will interact during the design and development of communicative messages. They explained that design thinking and production thinking are two important types of thinking processes that take place during an individuals interaction with resources and media he or she utilized.
The book is very relevant to the research concerning multimodal analysis because it helps widen the knowledge of students and readers in the field of communication, language, and media. Moreover, students will learn to take the challenge brought by the emergence of multimedia, multimodality, and multi-skiing. The book will supplement students understanding of designing multimedia that was learned in school. It is not only catered to students but all types of professionals who are interested in multimodal design such as journalists, designers, photographers, and other people who are connected to the of science and mathematics.
OHalloran, K. L. (2006). Multimodal discourse analysis systematic-functional perspectives.
London, England Continuum International Publishing.
The book discusses important research in the field of multimodal texts and multimodal discourses. It focuses mainly on the development of the theory and the methodology of analyzing discourses by utilizing various semiotic resources like visual images, architecture, language, and space. The book provides an explanation on how the multimodal discourses are produced through the interaction of different semiotic modes of communication. Different modes of communication may include static and dynamic visual images, language, electronic media, architecture, electronic print, or electronic film.
The book provides explanation on phase and transition, interaction of body movement and camera, use of color, typography, and layout. Other topics covered in the book include the development of multiple integrated semiotic model, visual semiosis in electronic films, application of system-functional theory in various semiotic resources, and analysis of three-dimensional space such as the Sydney Opera House.
Ventola, E., Charles, C., Kaltenbacher, M. (2004). Perspectives on multimodality. Amsterdam,
Netherlands John Benjamins Publishing Co.
The authors provided a background on various perspectives about multimodal discourse by focusing on methodological and theoretical issues such as multiple semiotic systems, mode hierarchies, and multimodal corpus annotation. The advent of computer and the growing use of the Internet allow scholars to be particularly interested on the characteristics of different modes of communication and the way these modes of communication can function semiotically and integrate in the emerging discourse analyses around the world.
The book can help widen the understanding of students on the similarity between language and non-linguistic semiotic mode of communication, different signs of nature within the multimodality perspective, role of text imaging in providing positive outcomes for the learners, and the influence of semiotic transformation in the formal language of mathematics on the effectiveness of science to provide description of the physical world. Moreover, students can learn how to apply multimodal analysis in various fields such as entertainment, medicine, mathematics, design of buildings, and translation.
Categories:
0 comments:
Post a Comment