Analyzing the associations among terms
The previously computed TermDocumentMatrix
, can also be used to identify the association between the cleaned terms found in the corpus. This simply suggests the correlation coefficient computed on the joint occurrence of term-pairs in the same document, which can be queried easily with the findAssocs
function.
Let's see which words are associated with data
:
> findAssocs(tdm, 'data', 0.1) data set 0.17 analyzing 0.13 longitudinal 0.11 big 0.10
Only four terms seem to have a higher correlation coefficient than 0.1, and it's not surprising at all that analyzing
is among the top associated words. Probably, we can ignore the set
term, but it seems that longitudinal
and big
data are pretty frequent idioms in package ...
Get Mastering Data Analysis with R now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.