Question: Apply the Latent Dirichlet Allocation (LDA) technique to complete the following: Find the optimal number of topics k for the text data. After determining k,
Apply the Latent Dirichlet Allocation (LDA) technique to complete the following: Find the optimal number of topics k for the text data. After determining k, provide a rationale for why this number of topics is considered optimal for the dataset.(15 pts) Display the term-probability and document-probability by setting the number of topics at k. Subsequently, explain the significance of these probabilities in the context of the chosen topics.(20 pts) Verify your outcomes from (a) and (b) above with the tidy() function. Discuss how the tidy() function's results support or refine your findings, and explain any insights or patterns revealed by this analysis.(20 pts)
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
