RESEARCH ARTICLE
Does image sentiment of major public emergency affect the stock market performance? New insight from deep learning techniques
Yun Liu,
Dengshi Huang,
Jianan Zhou,
Sirui Wang,
Yun Liu
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Search for more papers by this authorDengshi Huang
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Search for more papers by this authorCorresponding Author
Jianan Zhou
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Correspondence
Jianan Zhou, School of Economics and Management, Southwest Jiaotong University, Chengdu, China.
Email: [email protected]
Search for more papers by this authorSirui Wang
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Search for more papers by this authorYun Liu,
Dengshi Huang,
Jianan Zhou,
Sirui Wang,
Yun Liu
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Search for more papers by this authorDengshi Huang
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Search for more papers by this authorCorresponding Author
Jianan Zhou
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Correspondence
Jianan Zhou, School of Economics and Management, Southwest Jiaotong University, Chengdu, China.
Email: [email protected]
Search for more papers by this authorSirui Wang
School of Economics and Management, Southwest Jiaotong University, Chengdu, China
Service Science and Innovation Key Laboratory of Sichuan Province, Chengdu, China
Search for more papers by this authorFirst published: 14 August 2024
Abstract
Leveraging deep learning to analyse COVID-19 image sentiment, this study reveals its significant impact on stock market dynamics. It highlights how vivid imagery prompts marked emotional responses, altering market performance and how news sentiment can modulate this effect. Further, it underscores the pivotal role of forum-based investor sentiment, particularly affecting small-minus-big stocks during downturns and trading week commencements. This research not only advances behavioural finance understanding but also informs management and regulatory strategies.
Open Research
DATA AVAILABILITY STATEMENT
The datasets generated and analysed during the study are not publicly available but are available from the corresponding author upon request.
Supporting Information
| Filename | Description |
|---|---|
| acfi13313-sup-0001-AppendixS1-S3.docxWord 2007 document , 3 MB |
Appendices S1-S3 |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
REFERENCES
- Ammari, A., Chebbi, K. & Ben Arfa, N. (2023) How does the COVID-19 pandemic shape the relationship between twitter sentiment and stock liquidity of US firms? International Review of Financial Analysis, 88, 102633.
10.1016/j.irfa.2023.102633 Google Scholar
- Anastasiou, D., Ballis, A. & Drakos, K. (2022) Constructing a positive sentiment index for COVID-19: evidence from G20 stock markets. International Review of Financial Analysis, 81, 102111.
- Antweiler, W. & Frank, M.Z. (2004) Is all that talk just noise? The information content of internet stock message boards. The Journal of Finance, 59(3), 1259–1294.
- Baker, M. & Wurgler, J. (2007) Investor sentiment in the stock market. Journal of Economic Perspectives, 21(2), 129–151.
- Barber, B.M. & Odean, T. (2008) All that glitters: the effect of attention and news on the buying behavior of individual and institutional investors. Review of Financial Studies, 21(2), 785–818.
- Barry, A.M. (1997) Visual intelligence: perception, image, and manipulation in visual communication. Albany: State University of New York Press.
10.1515/9780791495841 Google Scholar
- Bazley, W.J., Cronqvist, H. & Mormann, M. (2021) Visual finance: the pervasive effects of red on investor behavior. Management Science, 67(9), 5616–5641.
- Black, F. (1986) Noise. The. Journal of Finance, 41(3), 528–543.
- Bollen, J., Mao, H. & Zeng, X. (2011) Twitter mood predicts the stock market. Journal of Computational Science, 2(1), 1–8.
- Borth, D., Chen, T., Ji, R. & Chang, S.-F. (2013) SentiBank: large-scale ontology and classifiers for detecting sentiment and emotions in visual content. In: Proceedings of the 21st ACM international conference on multimedia. Barcelona Spain: ACM, pp. 459–460.
10.1145/2502081.2502268 Google Scholar
- Borth, D., Ji, R., Chen, T., Breuel, T. & Chang, S.-F. (2013) Large-scale visual sentiment ontology and detectors using adjective noun pairs. In: Proceedings of the 21st ACM international conference on multimedia. Barcelona Spain: ACM, pp. 223–232.
10.1145/2502081.2502282 Google Scholar
- Campbell, J.Y., Grossman, S.J. & Wang, J. (1993) Trading volume and serial correlation in stock returns. The Quarterly Journal of Economics, 108(4), 905–939.
- Campbell, J.Y. & Thompson, S.B. (2008) Predicting excess stock returns out of sample: can anything beat the historical average? Review of Financial Studies, 21(4), 1509–1531.
- Chen, Y., Han, D. & Zhou, X. (2023) Mining the emotional information in the audio of earnings conference calls: a deep learning approach for sentiment analysis of securities analysts' follow-up behavior. International Review of Financial Analysis, 88, 102704.
10.1016/j.irfa.2023.102704 Google Scholar
- Das, S.R. & Chen, M.Y. (2007) Yahoo! For Amazon: sentiment extraction from small talk on the web. Management Science, 53(9), 1375–1388.
- De Long, J.B., Shleifer, A., Summers, L.H. & Waldmann, R.J. (1990) Noise trader risk in financial markets. Journal of Political Economy, 98(4), 703–738.
- Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2018) BERT: pre-training of deep bidirectional transformers for language understanding (version 2). arXiv: 1810.04805.
- Duan, J., Liu, H. & Zeng, J. (2017) Analysis on the information content of China's internet stock message boards. Journal of Financial Research, 10, 178–192.
- Duan, Y., Liu, L. & Wang, Z. (2021) COVID-19 sentiment and the Chinese stock market: evidence from the official news media and Sina Weibo. Research in International Business and Finance, 58, 101432.
- Duz Tan, S. & Tas, O. (2021) Social media sentiment in international stock returns and trading activity. Journal of Behavioral Finance, 22(2), 221–234.
- Fan, X., Wang, Y., Wang, D., Guo, W. & Hu, X. (2022) Heterogeneity analysis of information content for financial text from different sources: a hybrid text sentiment measurement method. Journal of Management World, 10, 78–101.
- Gao, Z., Ren, H. & Zhang, B. (2020) Googling investor sentiment around the world. Journal of Financial and Quantitative Analysis, 55(2), 549–580.
- García, D. (2013) Sentiment during recessions. The Journal of Finance, 68(3), 1267–1300.
- Geise, S. & Baden, C. (2015) Putting the image Back into the frame: modeling the linkage between visual communication and frame-processing theory: putting the image Back into the frame. Communication Theory, 25(1), 46–69.
- Gigerenzer, G. & Gaissmaier, W. (2011) Heuristic decision making. Annual Review of Psychology, 62(1), 451–482.
- González-Carvajal, S., & Garrido-Merchán, E. C. (2020). Comparing BERT against traditional machine learning text classification.arXiv: 2005.13012.
- Goyal, A. & Welch, I. (2008) A comprehensive look at the empirical performance of equity premium prediction. Review of Financial Studies, 21(4), 1455–1508.
- Hsu, Y.-L. & Tang, L. (2022) Effects of investor sentiment and country governance on unexpected conditional volatility during the COVID-19 pandemic: evidence from global stock markets. International Review of Financial Analysis, 82, 102186.
- Huang, D., Jiang, F., Tu, J. & Zhou, G. (2015) Investor sentiment aligned: a powerful predictor of stock returns. Review of Financial Studies, 28(3), 791–837.
- Iyer, A., Webster, J., Hornsey, M.J. & Vanman, E.J. (2014) Understanding the power of the picture: the effect of image content on emotional and political responses to terrorism: responses to images of terrorism. Journal of Applied Social Psychology, 44(7), 511–521.
- Jiang, F., Meng, L. & Tang, G. (2021) Media textual sentiment and Chinese stock return predictability. China Economic Quarterly, 21(4), 1323–1344.
- Jin, X., Gallagher, A., Cao, L., Luo, J. & Han, J. (2010) The wisdom of social multimedia: using flickr for prediction and forecast. In: Proceedings of the international conference on multimedia - MM’10, 1235. Firenze, Italy: ACM Press.
10.1145/1873951.1874196 Google Scholar
- Johnman, M., Vanstone, B.J. & Gepp, A. (2018) Predicting FTSE 100 returns and volatility using sentiment analysis. Accounting and Finance, 58(S1), 253–274.
- Joshi, D., Datta, R., Fedorovskaya, E., Luong, Q.-T., Wang, J., Li, J. et al. (2011) Aesthetics and emotions in images. IEEE Signal Processing Magazine, 28(5), 94–115.
- Kahneman, D. & Tversky, A. (1979) Prospect theory: an analysis of decision under risk. Econometrica, 47(2), 263–291.
- Liu, Q., Cheng, X., Su, S. & Zhu, S. (2018) Hierarchical complementary attention network for predicting stock Price movements with news. In: Proceedings of the 27th ACM international conference on information and knowledge management. Torino Italy: ACM, pp. 1603–1606.
10.1145/3269206.3269286 Google Scholar
- Manela, A. & Moreira, A. (2017) News implied volatility and disaster concerns. Journal of Financial Economics, 123(1), 137–162.
- Nelson, D.L., Reed, V.S. & Walling, J.R. (1976) Pictorial superiority effect. Journal of Experimental Psychology: Human Learning and Memory, 2(5), 523–528.
- Newhagen, J.E. & Reeves, B. (1992) The Evening's bad news: effects of compelling negative television news images on memory. Journal of Communication, 42(2), 25–41.
- Nickerson, R.S. (1998) Confirmation bias: a ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175–220.
10.1037/1089-2680.2.2.175 Google Scholar
- Obaid, K. & Pukthuanthong, K. (2022) A picture is worth a thousand words: measuring investor sentiment by combining machine learning and photos from news. Journal of Financial Economics, 144(1), 273–297.
- Ortis, A., Farinella, G. & Battiato, S. (2019) An overview on image sentiment analysis: methods, datasets and current challenges. In: Proceedings of the 16th international joint conference on E-business and telecommunications, 290–300. Prague, Czech Republic: SCITEPRESS - Science and Technology Publications.
10.5220/0007909602900300 Google Scholar
- Paivio, A. (1986) Mental representations: a dual coding approach. Oxford: Oxford University Press.
- Paivio, A. (1991) Images in mind: the evolution of a theory. London, UK: Harvester Wheatsheaf.
- Pfau, M., Haigh, M., Fifrick, A., Holl, D., Tedesco, A., Cope, J. et al. (2006) The effects of print news photographs of the casualties of war. Journalism and Mass Communication Quarterly, 83(1), 150–168.
- Powell, T.E., Boomgaarden, H.G., De Swert, K. & de Vreese, C.H. (2015) A clearer picture: the contribution of visuals and text to framing effects: visual framing effects. Journal of Communication, 65(6), 997–1017.
- Salisu, A.A. & Vo, X.V. (2020) Predicting stock returns in the presence of COVID-19 pandemic: the role of health news. International Review of Financial Analysis, 71, 101546.
- Schnaubelt, M., Fischer, T.G. & Krauss, C. (2020) Separating the signal from the noise – Financial machine learning for Twitter. Journal of Economic Dynamics and Control, 114, 103895.
- Shi, L., Teng, Z., Wang, L., Zhang, Y. & Binder, A. (2019) DeepClue: visual interpretation of text-based deep stock prediction. IEEE Transactions on Knowledge and Data Engineering, 31(6), 1094–1108.
10.1109/TKDE.2018.2854193 Google Scholar
- Siersdorfer, S., Minack, E., Deng, F. & Hare, J. (2010) Analyzing and predicting sentiment of images on the social web. In: Proceedings of the international conference on multimedia - MM’10. Firenze, Italy: ACM Press, p. 715.
10.1145/1873951.1874060 Google Scholar
- Slovic, P., Finucane, M.L., Peters, E. & MacGregor, D.G. (2007) The affect heuristic. European Journal of Operational Research, 177(3), 1333–1352.
- Tetlock, P.C. (2007) Giving content to investor sentiment: the role of Media in the Stock Market. The Journal of Finance, 62(3), 1139–1168.
- Yantis, S. & Jonides, J. (1984) Abrupt visual onsets and selective attention: evidence from visual search. Journal of Experimental Psychology: Human Perception and Performance, 10(5), 601–621.
- You, J. & Wu, J. (2012) Spiral of silence: media sentiment and the asset mispricing. Economic Research Journal, 47(7), 141–152.
- You, Q. (2016a) Robust visual-textual sentiment analysis. In: Proceedings of the 24th ACM international conference on multimedia. Amsterdam The Netherlands: ACM, pp. 1445–1449.
10.1145/2964284.2971475 Google Scholar
- You, Q. (2016b) Sentiment and emotion analysis for social multimedia: methodologies and applications. In: Proceedings of the 24th ACM international conference on multimedia. Amsterdam The Netherlands: ACM, pp. 1445–1449.
10.1145/2964284.2971475 Google Scholar
- You, Q., Jin, H. & Luo, J. (2017) Visual Sentiment Analysis by Attending on Local Image Regions. Proceedings of the AAAI Conference on Artificial Intelligence, 31(1).
10.1609/aaai.v31i1.10501 Google Scholar
- You, Q., Luo, J., Jin, H. & Yang, J. (2015) Robust image sentiment analysis using progressively trained and domain transferred deep networks. Proceedings of the AAAI Conference on Artificial Intelligence, 29(1).
10.1609/aaai.v29i1.9179 Google Scholar
- Zhang, X., Fuehres, H. & Gloor, P.A. (2011) Predicting stock market indicators through twitter “I hope it is not as bad as I fear”. Procedia - Social and Behavioral Sciences, 26, 55–62.
- Zhang, Y. & Swanson, P.E. (2010) Are day traders bias free?—evidence from internet stock message boards. Journal of Economics and Finance, 34(1), 96–112.
10.1007/s12197-008-9063-1 Google Scholar
