Provides text analysis in R, focusing on the use of a tokenized text format. In this format, the positions of tokens are maintained, and each token can be annotated (e.g., part-of-speech tags, dependency relations).
Prominent features include advanced Lucene-like querying for specific tokens or contexts (e.g., documents, sentences),
similarity statistics for words and documents, exporting to DTM for compatibility with many text analysis packages,
and the possibility to reconstruct original text from tokens to facilitate interpretation.

Managing, Querying and Analyzing Tokenized Text

package-ubuntu-20.04-r-4.0.5#cran#corpustools-0.4.10

<p><a href="tCorpus.html">(back to overview)</a>
</p>

<p><strong>Compare documents, and perform similarity based deduplication</strong>
</p>

<table summary="Rd table">
<tr>
<td style="text-align: left;">
  <a href="compare_documents.html">compare_documents()</a> </td>
<td style="text-align: left;"> Compare documents </td>
</tr>
<tr>
<td style="text-align: left;">
  <a href="tCorpus-cash-deduplicate.html">$deduplicate()</a> </td>
<td style="text-align: left;"> Remove duplicate documents
</td>
</tr>
</table>

package-ubuntu-20.04-r-4.0.5#cran#corpustools-0.4.10#docs#tCorpus_docsim

tCorpus_docsim

Description

Details

corpustools

We don't support your browser anymore

compare_documents()	Compare documents
$deduplicate()	Remove duplicate documents