On a Combined Analysis Framework for Multimodal Discourse Analysis

【Abstract】When people communicate，they do not only use language，that is，a single mode of communication，but also simultaneously use body languages，eye contacts，pictures，etc，which is called multimodal communication.The multimodal communication，as a matter of fact，is the most natural way of communication.Therefore，in order to make a complete discourse analysis，all the modes involved in an interaction or discourse should be taken into account and the new analysis framework for Multimodal Discourse Analysis ought to be created to move forward such type of analysis.In this passage，the author makes a tentative move to shape a new analysis framework for Multimodal Discourse Analysis.

【Keywords】Analysis Framework for Multimodal Discourse Analysis； Systemic-functional Grammar； Sigrid Norriss framework of Multimodal Discourse Analysis

Multimodal communication is the most common and natural communication.It occurs in human beings daily lives，with several modes of communication combining together to express the individuals meaning.When analyzing a discourse or interaction，all the modes of communication involved in the discourse or interaction should be taken into consideration so that the analysis can be complete.This is what Multimodal Discourse Analysis do.In this passage，a combined analysis framework is to be introduced，that is，the combination of Systemic-functional Grammar and Sigrid Norriss framework of Multimodal Discourse Analysis.Systemic-functional Grammar is used to analyze the language while the other modes of communication involved in the videos are to be analyzed with Sigrid Norriss framework of Multimodal Discourse Analysis.

1.The Reasons of Building a Combined Analysis Framework

In recent years，the researches on Multimodal Discourse Analysis have developed by leap and bounds.However，a complete theoretical framework for analyzing all modes of communication is not available due to the multimodal communications interdisciplinary nature.Multimodal communication is not concerned with one discipline but with several ones.The scholar who intends to build a complete theoretical framework for Multimodal Discourse Analysis is required to be versed in many disciplines，which hinders the advent of such a theoretical framework.In the field of Multimodal Discourse Analysis，most scholars focused their researches on specific parts of multimodal communication，which has made great achievements in certain modes，like picture or language but obviously it is not enough.In the authors view，a whole and complete analysis framework for Multimodal Discourse Analysis has to be shaped since usually a discourse or interaction is a unity with several modes of communication glued together.Therefore，in this passage，the author makes a tentative move to shape a new framework for the Multimodal Discourse Analysis，that is，the combination of Systemic-functional Grammar and Sigrid Norriss framework of Multimodal Discourse Analysis.Systemic-functional Grammar is used to analyze the language while the other modes of communication involved in the discourse or interaction are to be analyzed with Sigrid Norriss framework of Multimodal Discourse Analysis.

2.Theoretical Support for the Combined Analysis Framework

Sigrid Norriss framework of analyzing the multimodal communication is founded on the Interactional Sociolinguistics while M.A.K Hallidays Systemic-functional Grammar belongs to the category of social semiotics.The Interactional Sociolinguistics has a deep and close relation with Systemic-functional Grammar.

Their relation can be traced back to the origin of the western linguistics.In the history of the western linguistics，there were two kinds of conflictive points.One was represented by Protagoras and Plato，and the other was represented by Aristotle （Hu Zhuanglin，Zhu Yongsheng & Zhe delu，1987）.The two kinds of view interpreted by modern linguistic terms are shown in the table 3.1.

Table 3.1 Different Viewpoints Hold by the School of Protagoras and Plato，and the School of Aristotle

（Hu Zhuanglin，Zhu Yongsheng & Zhe delu，1987）

These two kinds of view have been developing accompanying the advancement of the western linguistics.Two branches of linguistics have been shaped based on these two kinds of view.And the comparison between these two branches of linguistic has shown in table 3.2.

Table 3.2 Comparison between Branch Rooted in Anthropology and Branch Rooted in Philosophy

（Hu Zhuanglin，Zhu Yongsheng & Zhe delu，1987）

From the table，such a conclusion can be made that Systemic-functional Grammar is sociological and belongs to the same branch with Sociolinguistics.This shows some sort of relation between Systemic-functional Grammar and Sociolinguistics.However，their relation is never so remote.Chinese scholar Yang Yonglin （2001） claimed that the London functional school，represented by Malinowsky and Firth，had an important effect on the shaping of Sociolinguistics by putting forward the theory of context of situation，which elaborated the relations among speaker，language form，language environment，etc.Xu Guozhang also stated that Halliday，as a great figure of functionalism linguistics，also offered great theoretical basement to the shaping of Sociolinguistics （Zhu Wanjin，1985）.And Zhao Ronghun （2004） concluded in Book Sociolinguistics that Sociolinguistics belonged to the group of functionalism in terms of the attribution of linguistic theory.Therefore，we can sum up that Systemic-functional Grammar is closely related to Sociolinguistics.

Interactional Sociolinguistics is one branch of Sociolinguistics.Therefore，the Interactional Sociolinguistics also has a close relation with the school of Systemic-functional Grammar.At least，they both belong to the same branch of western linguistics.The earlier study of Interactional Sociolinguistics was oriented on the research of low-level language units.With the deepening of researches，some scholars of Interactional Sociolinguistics enlarged the extent of research objectives.Continuous utterance and text became the focus of research，which was accompanied by the development of discourse analysis in the school of functionalism （Zhao Ronghun，2004）.These two schools share the same research objective，that is，the utterance and text.Although they take different approaches to do the discourse analysis on the utterance and text，there is no doubt that Interactional Sociolinguistics and the school of Systemic-functional Grammar keep an intimate relation with each other.

Based on the above discussion，a conclusion can be made that Sigrid Norriss framework of analyzing multimodal communications/interactions，which is based on Interactional Sociolinguistics，is closely related to Systemic-functional Grammar.In other word，Norriss framework is compatible with Systemic-functional Grammar.In addition，Norriss framework also shares some notions and ideas with Systemic-functional Grammar.For instance，in Norriss framework，the issue of “context of situation” is included； and Norris defines interaction as an exchange of communicated experiences，thoughts and feelings of the participants，which roughly equal to the Ideational Meta-function and Interpersonal Meta-function （Sigrid Norris，2004）.Thus，Sigrid Norriss framework of analyzing multimodal communications/interactions and Systemic-functional Grammar can be utilized together to analyze the multimodal communications/interactions.Therefore，nearly all the modes involved in a discourse or interaction can be analyzed.

3.Conclusions

Based on the above discussion，such a conclusion can be made that a framework with a combination of Systemic-functional Grammar and Sigrid Norriss framework of Multimodal Discourse Analysis，is workable and can be used to make Multimodal Discourse Analysis.

References：

[1]Norris，S.（2004）.Analyzing Multimodal Interaction：A Methodological Framework[M].London：Routledge.

[2]胡壯麟，朱永生，張德祿.（1987）.系統(tǒng)功能語(yǔ)法概論[M].長(zhǎng)沙：湖南教育出社.

[3]楊永林.（2001）.社會(huì)語(yǔ)言學(xué)40年[J].外語(yǔ)教學(xué)與研究.

[4]趙蓉暉.（2004）.社會(huì)語(yǔ)言學(xué)[C].上海：上海外語(yǔ)教育出版社.

[5]祝畹瑾.（1985）.社會(huì)語(yǔ)言學(xué)譯文集[C].北京：北京大學(xué)出版社.

作者簡(jiǎn)介：竇瑞芳（1984年），女，河南焦作人，漢族，助教，研究生，研究方向：話(huà)語(yǔ)分析、系統(tǒng)功能語(yǔ)法、多模態(tài)話(huà)語(yǔ)分析、文學(xué)翻譯。