There's more...

The following figure depicts the LDA in a nutshell:

There are two approaches to document analysis. We can simply use matrix factorization to decompose a large matrix of datasets to a smaller matrix (topic assignments) times a vector (topics themselves):

Get Apache Spark 2.x Machine Learning Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.