Text Processing Basics

This book covers basic concepts of text processing with an emphasis on methods used in information retrieval, document matching and clustering, and natural language processing (NLP). It starts by defining the concepts of tokenization, n-grams, shingles, and text similarity measures. It then introduces core problems in NLP and in text matching and clustering, followed by algorithms for them. Covered problems and algorithms include those for text clustering, text classification, topic modeling, sequence modeling, and information extraction.