Skip to content

Convenient way of providing LDA topic summary #1411

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
abgoswam opened this issue Oct 27, 2018 · 3 comments
Closed

Convenient way of providing LDA topic summary #1411

abgoswam opened this issue Oct 27, 2018 · 3 comments

Comments

@abgoswam
Copy link
Member

abgoswam commented Oct 27, 2018

In the LdaTransform, the details of the learnt model are contained in the LdaState object. When the user wants to introspect the LDA model learnt during the transformation, we return a topic summary vector .

We need to find a proper way of returning topic summary information to the user. Specifically the words that map to the topic summary vector

For this we need to figure out how to extract details from the LdaState object using C#. Currently LdaState invokes native code behind the scenes to get model info.

@abgoswam
Copy link
Member Author

It turns out this can be handled by mapping slot names from the input schema during training. I have taken care of this in PR #1410

@abgoswam
Copy link
Member Author

PR #1410 took care of this

@najeeb-kazmi
Copy link
Member

This is again an issue since the PigSty API was removed. This functionality is no longer available in the Dynamic API. #4322 tracks all the issues filed for LDA topic summary.

@ghost ghost locked as resolved and limited conversation to collaborators Mar 27, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants