MLFlowLogger Issues with LightningCLI #14047
Replies: 2 comments
-
It looks to me that it's still the case. I can't have a |
Beta Was this translation helpful? Give feedback.
-
If you are using mlflow, my recommendation would be to implement a subclass of If for some reason someone truly wants to use mlflow and save the config locally, then I don't see why not creating a pull request that does the |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm having trouble working around an issue that arises due to the
save_dir
property of the MLFlowLogger returningNone
whentracking_uri
is set. TheSaveConfigCallback
setup method makes the assertion thatlog_dir
is not None, butlog_dir
is assigned astrainer.log_dir
, which is set to the logger'ssave_dir
attribute, which for some reason returnsNone
in the MLFlowLogger when you are using a remote tracking server. I was hoping I could simply intervene and manually override thetrainer.log_dir
property, but it's read-only so that doesn't work. This seems fundamentally broken and ought to be fixed in general, but I was hoping someone else had run into this issue and has a workaround that I can use for now.Edit: I temporarily fixed this by extending the
SaveConfigCallback
class to override the setup method. My updated version is exactly the same, but it replaceswith
I don't know if this has potential downstream consequences, but for my use case it got things running properly.
Beta Was this translation helpful? Give feedback.
All reactions