A survey and an experimental comparison of methods for text clustering: application to scientific articles

Authors

P.A. Parhomenko, A.A. Grigorev, N.A. Astrakhantsev

Abstract

Text documents clustering is used in many applications such as information retrieval, exploratory search, spam detection. This problem is the subject of many scientific papers, but the specificity of scientific articles in regards to the clustering efficiency remains to be studied insufficiently; in particular, if all documents belong to the same domain or if full texts of articles are unavailable. This paper presents an overview and an experimental comparison of text clustering methods in application to scientific articles. We study methods based on bag of words, terminology extraction, topic modeling, word embedding and document embedding obtained by artificial neural networks (word2vec, paragraph2vec).

Full text of the paper in pdf (in Russian)

Keywords

text documents clustering, bag of words, terminology extraction, topic modeling, word and document embedding, artificial neural networks

Edition

Trudy ISP RAN/Proc. ISP RAS, 2017, vol. 29, issue 2, pp. 161-200 (in Russian).

DOI: 10.15514/ISPRAS-2017-29(2)-6

Research Group

Information Systems

All publications during 2017

All publications