Deep Semi-supervised Learning with Weight Map for Review Helpfulness Prediction

Hua Yin1, Zhensheng Hu1, Yahui Peng2, Zhijian Wang1, Guanglong Xu3 and Yanfang Xu4

  1. Information School, Guangdong University of Finance & Economics, Guangzhou, Guangdong
    510320, China
  2. School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou
    Guangdong, 510275, China
  3. School of Statistics and Mathematics, Guangdong University of Finance & Economics
    Guangzhou, Guangdong, 510320, China
  4. School of Art and Design, Guangdong University of Finance & Economics, Guangzhou
    Guangdong, 510320, China

Abstract

Helpful online product reviews, which include massive information, have large impacts on customers’ purchasing decisions. In most of e-commerce platforms, the helpfulness of reviews are decided by the votes from other customers. Making full use of these reviews with votes has enormous commercial value, especially in product recommendation. It drives researchers to study the technologies about how to evaluate the review helpfulness automatically. Although Deep Neural Network(DNN), learning from the historical reviews and labels, computed by the votes, has demonstrated effective results, it still has suffered insufficient labeled reviews problem. When the helpfulness of a large number of reviews is unknown for lack of votes, or some useful latest reviews with less votes are submerged by the past reviews, the accuracy of current DNN model decreases quickly. Therefore, we propose an end-to-end deep semi-supervised learning model with weight map, which makes full use of the unlabeled reviews. The training process in this model is divided into three stages:obtaining base classifier by less labeled reviews, iteratively applying weight map strategy on large unlabeled reviews to obtain pseudo-labeled reviews, training on above combined reviews to obtain the re-training classifier. Based on this novel model, we develop an algorithm and conduct a series of experiments, on Amazon Review Dataset, from the aspects of the baseline neural network selection and the strategies comparisons, including two labeling and three weighting strategies. The experimental results demonstrate the effectiveness of our method on utilizing the unlabeled data. And our findings show that the model adopted batch labeling strategy and non-linear weight mapping method has achieved the best performance.

Key words

Semi-supervised learning; Review helpfulness; Pseudo label; Weight map; Labeling strategy

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS201228044Y

Publication information

Volume 18, Issue 4 (September 2021)
Year of Publication: 2021
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Yin, H., Hu, Z., Peng, Y., Wang, Z., Xu, G., Xu, Y.: Deep Semi-supervised Learning with Weight Map for Review Helpfulness Prediction. Computer Science and Information Systems, Vol. 18, No. 4, 1159–1174. (2021), https://doi.org/10.2298/CSIS201228044Y