Skip to content

ML.NET needs pipeline cancel (image classification in particular) #413

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
LittleLittleCloud opened this issue Dec 25, 2019 · 3 comments
Closed

ML.NET needs pipeline cancel (image classification in particular) #413

LittleLittleCloud opened this issue Dec 25, 2019 · 3 comments
Assignees
@LittleLittleCloud
Milestone
February 2020

Comments

@LittleLittleCloud
Copy link
Contributor

LittleLittleCloud commented Dec 25, 2019 •
edited
Loading

Steps to reproduce:

  • open task manager
  • start image training, find the x64 process and take down the memory usage.
  • cancel and switch to another scenario, start training. the memory usage should drop down vastly, but it doesn't
  • after the new training complete, the memory usage for x64 process is still quite high

We do have to actually CANCEL the training process. It's highly important, especially to compute-intense tasks like image classification. Or it will significantly affect other running tasks. (In my case it almost freeze my laptop even after I hit cancel, and task manager shows both CPU and memory usage are quite high, it doesn't recover until I kill the service process)
@LittleLittleCloud LittleLittleCloud changed the title Image training doesn't actually stop after cancel and switch to new scenario Image training doesn't actually stop after cancel /switch to new scenario Jan 2, 2020
@JakeRadMSFT
Copy link
Contributor

JakeRadMSFT commented Jan 3, 2020 •
edited
Loading

Thanks for reporting! I agree, lets push on ML.NET to support a true pipeline cancel.

@JakeRadMSFT JakeRadMSFT changed the title Image training doesn't actually stop after cancel /switch to new scenario ML.NET needs pipeline cancel (image classification in particular) Jan 3, 2020
@JakeRadMSFT
Copy link
Contributor

Can you open a bug in ML.NET repo (or find one) and reference it here?

@JakeRadMSFT JakeRadMSFT added this to the January 2020 milestone Jan 6, 2020
@LittleLittleCloud
Copy link
Contributor Author

Issue in machine learning

@JakeRadMSFT JakeRadMSFT added the P1 label Jan 7, 2020
@LittleLittleCloud LittleLittleCloud self-assigned this Jan 31, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@LittleLittleCloud LittleLittleCloud

Labels
None yet
Projects
None yet
Milestone
February 2020
Development

No branches or pull requests
2 participants
@LittleLittleCloud @JakeRadMSFT