传播的本质是人类交流，而交流的目的是达成共识。网络中介交往渐趋日常化的当下，emoji作为文本信息的情感表达补充，发挥了类似面对面交流中非语言符号的效用。根据前人研究，表情符号主要有情感表达和语义补充两大功能，均与文本协同影响受众的信息理解。对于表情符号对受众认知加工过程的影响如何，尚无明确的研究结论。本研究以皮尔斯的符号传播理论为参照，从受众理解的角度出发，建构emoji与文本协同的作用机制框架，提出emoji与文本协同使用规则这一共同基础是影响理解过程的关键所在，并跨学科采用认知神经科学ERPs的方法，借助启动实验范式考察匹配、相悖、无关三种情绪义关系下，受众对前置位emoji协同文本交流的认知机制。结果发现，尽管被试的反应正确率与正确反应时无显著差异，但不同语义关系下被试的文本认知加工过程存在显著差异。匹配、相悖两条件N1波幅较无关条件下N1波幅显著更负，P2波幅显著更正；相悖条件下N400波幅较匹配条件下显著更负。这说明emoji并未显著影响被试文本理解的结论，但在文本前使用emoji能够提升被试理解文本时的注意程度与认知加工程度；emoji与文本的情绪义关系对文本情绪义理解过程有显著影响，情绪义相悖的emoji与文本由于不符合一般的语用规律，受众需要调用更多的认知资源，整合更多的既有信息，才能理解文本意义。研究结果对未来理解网络跨文化传播现象、测量场景视觉画面与语言文本的协同作用具有重要意义。

The essence of communication is human exchange, and the purpose of interaction is to reach consensus. As Internet mediated communication（IMC）becomes increasingly common, emoji, as a supplement to emotional textual information in IMC, plays a role similar to that of non-linguistic symbols in face-to-face communication. Previous studies show that emoji are primarily used to express emotion, and supply semantic of the message, all of which have an impact on the receivers’ understanding of the text. The influence of emoticons on the cognitive processing of the audience, however, is not fully understood. This study is based on Pierce's semiotics communication theory and adopts an audience-centered approach. It identifies the framework of text and emoji synergy mechanism and proposes that the commens of the synergistic use of text and symbol is key to the understanding of this process. The study applies an ERPs methodology and uses the priming paradigm to examine the cognitive mechanism of emoji-text communication under the three emotional semantic conditions: consistent, inconsistent and unrelated. Although the results show no significant differences in correct response rate and reaction time under the three treatments, the ERPs results reveal that the cognitive processing of subjects under different semantic conditions were significantly different. The N1 under the consistent and inconsistent conditions were significantly more negative than that in the unrelated condition, and P2 is significantly positive. The N400 under the inconsistent condition is significantly more negative than that under the consistent and unrelated condition. This shows that while emoji does not significantly affect the understanding of the emotional text, watching an emoji before reading the text can improve the attention and cognitive processing level during the process. The emotional semantic relationship between emoji and the text has a significant impact on the understanding of the text emotion, as the inconsistency between the emoji and the text do not conform to the general pragmatic rules, so the audience needs to spare additional cognitive resources and integrate more available information to comprehend the meaning of the text. The results of this study are of great significance for understanding the phenomenon of online cross-cultural communication and measuring the synergistic effect between visual information and texts in the future.