A hybrid MCDM model combining DANP with TODIM to evaluate the information quality of community question answering in a two-dimensional linguistic environment
Corresponding Author
Ming Li
School of Economics and Management, China University of Petroleum-Beijing, Beijing, China
Correspondence
Ming Li, School of Economics and Management, China University of Petroleum-Beijing, Beijing, 102249, China.
Email: [email protected]
Search for more papers by this authorYing Li
School of Economics and Management, China University of Petroleum-Beijing, Beijing, China
Search for more papers by this authorQijin Peng
School of Economics and Management, China University of Petroleum-Beijing, Beijing, China
Search for more papers by this authorJun Wang
School of Economics and Management, Beihang University, Beijing, China
Search for more papers by this authorCorresponding Author
Ming Li
School of Economics and Management, China University of Petroleum-Beijing, Beijing, China
Correspondence
Ming Li, School of Economics and Management, China University of Petroleum-Beijing, Beijing, 102249, China.
Email: [email protected]
Search for more papers by this authorYing Li
School of Economics and Management, China University of Petroleum-Beijing, Beijing, China
Search for more papers by this authorQijin Peng
School of Economics and Management, China University of Petroleum-Beijing, Beijing, China
Search for more papers by this authorJun Wang
School of Economics and Management, Beihang University, Beijing, China
Search for more papers by this authorFunding information: National Natural Science Foundation of China, Grant/Award Numbers: 71571191, 71871005, 91646122
Abstract
Evaluating the information quality of cQA (community question-answering) websites helps users select a cQA website with high-quality information and improves the information quality. In this paper, an approach to evaluating the information quality of cQA based on a novel hybrid multicriteria decision-making (MCDM) model is proposed. First, the source, content, expression and usefulness criteria for evaluating the information quality of the cQA are established. Then, considering the ambiguity and inner correlations of the criteria, DANP ([DEMATEL]-based Analytic Network Process) and TODIM (interactive and multiple attribute decision making, in Portuguese) methods are combined in a two-dimensional linguistic environment to process linguistic evaluation information. Lastly, the proposed approach is applied to evaluate the quality of five popular cQA websites. The key criteria are identified, and the evaluation results are derived comprehensively. The key factors consist of reputation, coverage, politeness, usability, helpfulness, clarity, readability and conciseness. The websites, Know almost and Baidu knows, perform better in terms of information quality. The application, along with the sensitivity analysis and comparative analysis, shows the effectiveness of the proposed model. The proposed approach has both practical and research implications. It provides an approach for users to choose websites, and, for operators, to improve the information quality of their website. The evaluation criteria and their relations provide a reference for research on the information quality. The evaluation method considers the user's psychological information to provide a more accurate MCDM approach. The comprehensive aspects of the experiment can be used to verify the other MCDM methods.
REFERENCES
- Alali, F., & Tolga, A. C. (2019). Portfolio allocation with the TODIM method. Expert Systems with Applications, 124, 341–348. https://doi.org/10.1016/j.eswa.2019.01.054
- Amiri, H., Pourebrahim, S., Danehkar, A., & Mokhtar, M. B. (2020). Location-based planning for sustainable agro-processing industries using land suitability assessment and DANP-VIKOR technique. Arabian Journal of Geosciences, 13(3), 1–11. https://doi.org/10.1007/s12517-020-5097-2
- Chen, M.-Y., & Chen, A.-P. (2005). Integrating option model and knowledge management performance measures: an empirical study. Journal of Information Science, 31(5), 381–393. https://doi.org/10.1177/0165551505055402
- Cheng, Y., Zhang, X., Wang, H., & Jiang, S. (2018). How to improve the answering effectiveness in pay-for-knowledge community. Companion of the Web Conference 2018 on the Web Conference 2018-WWW '18, New York, NY, ACM Press. pp. 313–317. https://doi.org/10.1145/3184558.3186342
- Demoulin, N. T. M., & Coussement, K. (2018). Acceptance of text-mining systems: The signaling role of Information quality. Information & Management, 57(1), 103120. https://doi.org/10.1016/j.im.2018.10.006
- Ding, X.-F., & Liu, H.-C. (2018). A 2-dimension uncertain linguistic DEMATEL method for identifying critical success factors in emergency management. Applied Soft Computing, 71, 386–395. https://doi.org/10.1016/J.ASOC.2018.07.018
- Figueroa, A., Gómez-Pantoja, C., & Neumann, G. (2019). Integrating heterogeneous sources for predicting question temporal anchors across yahoo! Answers. Information Fusion, 50, 112–125. https://doi.org/10.1016/J.INFFUS.2018.10.006
- Fu, H., & Oh, S. (2019). Quality assessment of answers with user-identified criteria and data-driven features in social Q&a. Information Processing and Management, 56(1), 14–28. https://doi.org/10.1016/j.ipm.2018.08.007
- Gasser, L., Twidale, M. B., & Smith, L.C. (2007). A framework for information quality assessment. Journal of the American Society for Information Science and Technology, 58(12), 1720–1733. https://doi.org/10.1002/asi
- Göçer, F., & Büyüközkan, G. (2020). Assessment of big data vendors by intuitionistic fuzzy TODIM. In Advances in intelligent systems and computing (Vol. 1029, pp. 574–582). Cham: Springer Verlag. https://doi.org/10.1007/978-3-030-23756-1_70
- Hu, H., Liu, B., Wang, B., Liu, M., & Wang, X. (2013). Multimodal DBN for predicting high-quality answers in cQA portals. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2009. pp. 843–847.
- Kang, J.-W., & Namkung, Y. (2019). The information quality and source credibility matter in customers' evaluation toward food O2O commerce. International Journal of Hospitality Management, 78, 189–198. https://doi.org/10.1016/J.IJHM.2018.10.011
- Li, L., He, D., Jeng, W., Goodwin, S., & Zhang, C. (2015). Answer quality characteristics and prediction on an academic Q&A site. Proceedings of the 24th International Conference on World Wide Web-WWW '15 Companion, New York, NY, ACM Press. pp. 1453–1458. https://doi.org/10.1145/2740908.2742129
- Li, M., Lu, X., Chen, L., & Wang, J. (2020). Knowledge map construction for question and answer archives. Expert Systems with Applications, 141, 112923. https://doi.org/10.1016/j.eswa.2019.112923
- Liu, B., Feng, J., Liu, M., Hu, H., & Wang, X. (2015). Predicting the quality of user-generated answers using co-training in community-based question answering portals. Pattern Recognition Letters, 58, 29–34. https://doi.org/10.1016/j.patrec.2015.02.015
- Liu, P. (2012). An approach to group decision making based on 2-dimension uncertain linguistic information. Technological and Economic Development of Economy, 18(3), 424–437. https://doi.org/10.3846/20294913.2012.702139
- Liu, P., & Teng, F. (2015). An extended TODIM method for multiple attribute group decision making based on intuitionistic uncertain linguistic variables. Journal of Intelligent and Fuzzy Systems, 29(2), 701–711. https://doi.org/10.3233/IFS-141441
- Liu, P., & Teng, F. (2016). An extended TODIM method for multiple attribute group decision-making based on 2-dimension uncertain linguistic variable. Complexity, 21(5), 20–30. https://doi.org/10.1002/cplx.21625
- Liu, P., & Teng, F. (2018). Multiple attribute decision-making method based on 2-dimension uncertain linguistic density generalized hybrid weighted averaging operator. Soft Computing, 22(3), 797–810. https://doi.org/10.1007/s00500-016-2384-7
- Liu, P., & Teng, F. (2019). Probabilistic linguistic TODIM method for selecting products through online product reviews. Information Sciences, 485, 441–455. https://doi.org/10.1016/J.INS.2019.02.022
- Liu, P., & Yu, X. (2014). 2-dimension uncertain linguistic power generalized weighted aggregation operator and its application in multiple attribute group decision making. Knowledge-Based Systems, 57, 69–80. https://doi.org/10.1016/J.KNOSYS.2013.12.009
- Liu, Q. (2014). An extended TOPSIS method for multiple attribute decision making problems with unknown weight based on 2-dimension uncertain linguistic variables. Journal of Intelligent & Fuzzy Systems, 27(5), 2221–2230. https://doi.org/10.3233/IFS-141186
- Pal, A., Margatan, J., & Konstan, J. (2012). Question temporality. Proceedings of the ACM 2012 conference on computer supported cooperative work-CSCW '12. New York, NY, ACM Press. p. 257. https://doi.org/10.1145/2145204.2145246
- Qin, J., Liu, X., & Pedrycz, W. (2017). An extended TODIM multi-criteria group decision making method for green supplier selection in interval type-2 fuzzy environment. European Journal of Operational Research, 258(2), 626–638. https://doi.org/10.1016/J.EJOR.2016.09.059
- Rao, L., & Osei-Bryson, K.-M. (2007). Towards defining dimensions of knowledge systems quality. Expert Systems with Applications, 33(2), 368–378. https://doi.org/10.1016/J.ESWA.2006.05.003
- Roy, P. K., Singh, J. P., Baabdullah, A. M., Kizgin, H., & Rana, N. P. (2018). Identifying reputation collectors in community question answering (CQA) sites: Exploring the dark side of social media. International Journal of Information Management, 42, 25–35. https://doi.org/10.1016/J.IJINFOMGT.2018.05.003
- Seppänen, H., & Virrantaus, K. (2015). Shared situational awareness and information quality in disaster management. Safety Science, 77, 112–122. https://doi.org/10.1016/j.ssci.2015.03.018
- Shah, C., & Pomerantz, J. (2010). Evaluating and predicting answer quality in community QA. Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval-SIGIR '10, New York, NY, ACM Press. p. 411. https://doi.org/10.1145/1835449.1835518
- Shamala, P., Ahmad, R., Zolait, A., & Sedek, M. (2017). Integrating information quality dimensions into information security risk management (ISRM). Journal of Information Security and Applications, 36, 1–10. https://doi.org/10.1016/J.JISA.2017.07.004
- Supeekit, T., Somboonwiwat, T., & Kritchanchai, D. (2016). DEMATEL-modified ANP to evaluate internal hospital supply chain performance. Computers & Industrial Engineering, 102, 318–330. https://doi.org/10.1016/J.CIE.2016.07.019
- Tian, Z., Nie, R., Wang, J., & Li, L. (2019). Group multigranular linguistic QFD for prioritizing service designs with combined weighting method. Expert Systems, 36(4), e12419. https://doi.org/10.1111/exsy.12419
- Toba, H., Ming, Z.-Y., Adriani, M., & Chua, T.-S. (2014). Discovering high quality answers in community question answering archives using a hierarchy of classifiers. Information Sciences, 261, 101–115. https://doi.org/10.1016/J.INS.2013.10.030
- Tsai, W.-H., & Hsu, W. (2010). A novel hybrid model based on DEMATEL and ANP for selecting cost of quality model development. Total Quality Management & Business Excellence, 21(4), 439–456. https://doi.org/10.1080/14783361003606852
- Tzeng, G.-H., Chiang, C.-H., & Li, C.-W. (2007). Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL. Expert Systems with Applications, 32(4), 1028–1044. https://doi.org/10.1016/J.ESWA.2006.02.004
- Wang, X., Wang, J., & Zhang, H. (2019). Distance-based multicriteria group decision-making approach with probabilistic linguistic term sets. Expert Systems, 36(2), e12352. https://doi.org/10.1111/exsy.12352
- Wen, J., Tu, H., Cheng, X., Xie, R., & Yin, W. (2019). Joint modeling of users, questions and answers for answer selection in CQA. Expert Systems with Applications, 118, 563–572. https://doi.org/10.1016/J.ESWA.2018.10.038
- Wu, Y., Liu, L., Gao, J., Chu, H., Xu, C., Wu, Y., … Xu, C. (2017). An extended VIKOR-based approach for pumped hydro energy storage plant site selection with heterogeneous information. Information, 8(3), 106. https://doi.org/10.3390/info8030106
- Wu, Y., Sun, X., Lu, Z., Zhou, J., & Xu, C. (2019). Optimal site selection of straw biomass power plant under 2-dimension uncertain linguistic environment. Journal of Cleaner Production, 212, 1179–1192. https://doi.org/10.1016/j.jclepro.2018.12.091
- Zadeh, P. A., Wang, G., Cavka, H. B., Staub-french, S., & Pottinger, R. (2017). Information quality assessment for facility management. Advanced Engineering Informatics, 33, 181–205. https://doi.org/10.1016/j.aei.2017.06.003
- Zha, X., Yang, H., Yan, Y., Liu, K., & Huang, C. (2018). Computers in human behavior exploring the effect of social media information quality, source credibility and reputation on informational fi t-to-task: Moderating role of focused immersion. Computers in Human Behavior, 79, 227–237. https://doi.org/10.1016/j.chb.2017.10.038
- Zhang, X., & Xu, Z. (2014). Interval programming method for hesitant fuzzy multi-attribute group decision making with incomplete preference over alternatives. Computers & Industrial Engineering, 75, 217–229. https://doi.org/10.1016/J.CIE.2014.07.002
- Zhu, Z., Bernhard, D., & Gurevych, I. (2009). A multi-dimensional model for assessing the quality of answers in social Q&A sites.
