Proceedings of ISP RAS


A survey and an experimental comparison of methods for text clustering: application to scientific articles

P.A. Parhomenko (ISP RAS, Moscow, Russia; MSU, Moscow, Russia)
A.A. Grigorev (ISP RAS, Moscow, Russia; HSE, Moscow, Russia)
N.A. Astrakhantsev (ISP RAS, Moscow, Russia)

Abstract

Text documents clustering is used in many applications such as information retrieval, exploratory search, spam detection. This problem is the subject of many scientific papers, but the specificity of scientific articles in regards to the clustering efficiency remains to be studied insufficiently; in particular, if all documents belong to the same domain or if full texts of articles are unavailable. This paper presents an overview and an experimental comparison of text clustering methods in application to scientific articles. We study methods based on bag of words, terminology extraction, topic modeling, word embedding and document embedding obtained by artificial neural networks (word2vec, paragraph2vec).

Keywords

text documents clustering; bag of words; terminology extraction; topic modeling; word and document embedding; artificial neural networks

Edition

Proceedings of the Institute for System Programming, vol. 29, issue 2, 2017, pp. 161-200.

ISSN 2220-6426 (Online), ISSN 2079-8156 (Print).

DOI: 10.15514/ISPRAS-2017-29(2)-6

Full text of the paper in pdf (in Russian) Back to the contents of the volume