Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Update statistics of an existing workflow #597

Open
EvenOldridge opened this issue Feb 24, 2021 · 1 comment
Open

[FEA] Update statistics of an existing workflow #597

EvenOldridge opened this issue Feb 24, 2021 · 1 comment
Labels
Iterative Deployment Iterative training, monitoring, and deployment

Comments

@EvenOldridge
Copy link
Member

In addition to workflow.fit() and workflow.transform() we need a workflow.update() which takes the existing fit and updates the statistics.

For most ops this should be very straightforward, but may require us to capture additional data associated with the statistics like the number of entries.

This feature is a key part of continuous training of recommender systems.

@EvenOldridge EvenOldridge added the Iterative Deployment Iterative training, monitoring, and deployment label Apr 20, 2021
@viswa-nvidia viswa-nvidia added this to the NVTabular v0.7 milestone Apr 26, 2021
@gabrielspmoreira
Copy link
Member

Issue #798 addresses the incremental pre-processing of categorical features.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Iterative Deployment Iterative training, monitoring, and deployment
Projects
None yet
Development

No branches or pull requests

4 participants