The Impact of Verbal and Visual Content on Consumer Engagement in Social Media Marketing

• 成果类型: Article; Early Access
• 署名作者: Liu, Lei; Wang, Yingfei; Fang, Zhen; Wu, Shaohui
• 署名单位: Central University of Finance & Economics; University of Washington; University of Washington Seattle; Fudan University; Harbin Institute of Technology
• 刊物名称: PRODUCTION AND OPERATIONS MANAGEMENT
• ISSN/ISSBN: 1059-1478
• DOI: 10.1177/10591478251349892
• 发表日期: 2025
• 关键词: Consumer engagement; Social media; Text and image congruency; Deep learning; Topic models

摘要

Social media marketing has been relentlessly developed and integrated into firm operations. On social media platforms, firms rely on a combination of verbal and visual elements to communicate with consumers and attract their attention. The present research investigates how the semantic relationship between text and image information affects consumer engagement (forwards and comments). Leveraging a large-scale dataset of firm-generated messages, we use deep learning, large language models, and topic models to quantify each text-image message with a theorized two-dimensional text-image incongruency (relevancy and expectancy). Relevancy is how closely the information aligns with the main message. Expectancy is how predictable or surprising the information is based on what people expect, which concerns long-term affective and cognitive memories about one's past and present experiences. We find that the interaction of relevancy and expectancy, two distinct dimensions at the cognitive level, is a crucial antecedent of consumer engagement on social media. High-relevancy-high-expectancy (HRHE) content and low-relevancy-low-expectancy (LRLE) content are the most effective strategies, whereas high-relevancy-low-expectancy (HRLE) and low-relevancy-high-expectancy (LRHE) contents do not work so well. Furthermore, this paper also uncovers the distinct nature of consumer engagement forms in social media settings, including forwards and comments. In particular, HRHE offers the exclusive benefit of boosting forwards while the two strategies are equally effective in eliciting comments. This research derives several important operational implications of consumer engagement and social media marketing by addressing the importance of multi-dimensional text-image incongruency and contributes to the literature on operations management and marketing interface.