Research on Text Classification Method based on PTF-IDF and Cosine Similarity

Open Access

Abstract: Text classification is a foundational task in many NLP applications. The text classification task in the era of big data faces new challenges. We propose a Promoted TF-IDF (Promoted-TF-IDF) and cosine similarity method for text classification. In our model, with the pre-trained word segmentation tool, we apply PTF-IDF method to judge which words play key roles in text classification to capture the key components in category. We also apply Cosine Similarity algorithm to judge similarity between text and category. We conduct experiments on commonly used datasets. The experimental results show that the proposed method outperforms the state-of-the-art methods on several datasets.

Keywords: Text classification, TF-IDF, Computer Application, Natural Language Processing

Yunxiang Liu, Qi Xu, Zhang Tang

The Author field can not be Empty

School of Computer Science & Information Engineering Shanghai Institute of Technology Shanghai, China

The Institution field can't be Empty

Volume 6, Issue 1

Volume and Issue can't be empty

335-338

The Page Numbers field can't be Empty

2432-5465

01-06-2020

Publication Date field can't be Empty