Skip to content

TensorBoard is "smoothing" lines with two points #1127

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Corbalt opened this issue Apr 11, 2018 · 4 comments
Open

TensorBoard is "smoothing" lines with two points #1127

Corbalt opened this issue Apr 11, 2018 · 4 comments

Comments

@Corbalt
Copy link

Corbalt commented Apr 11, 2018

If you generate a summary with two points on TensorBoard and apply smoothing, the "smoothed" line will not equal the true line. This is silly. :)

@nfelt
Copy link
Contributor

nfelt commented Apr 13, 2018

It could probably be smarter in this case but it's quite hard to get a smoothing algorithm that behaves "reasonably" in every single case; there are always tradeoffs. See #610 for the last smoothing change, and #786 for another issue with the current algorithm.

Quoting Dandelion from #610 (comment): "It seems that every change in the smoothing algorithm results in new tradeoffs and biases, and new requests to change the algorithm. At this point it's not a priority for the team, so just filing an issue probably won't directly result in changes. However, the smoothing algorithm is actually a very simple piece of code to change. If you come up with a new algorithm, and demonstrate persuasively why it is an improvement over the current one (taking into account new biases and edge cases that it introduces), I'll happily merge it."

@jart
Copy link
Contributor

jart commented Apr 13, 2018

@Corbalt I agree and I'm interested in knowing if a use case exists for having two samples in a scalars chart?

@Corbalt
Copy link
Author

Corbalt commented Apr 13, 2018

If you train a tf.estimator model with default settings, it performs eval every 10 minutes. If your training takes less than 10 minutes, you end up with eval plots with two points: one from the start of training and one from the end. This was the situation I was in when I pulled up TB and saw the plot. I was surprised at my metrics being low, but realized it was due to the smoothed line being inaccurate.

@bileschi
Copy link
Collaborator

bileschi commented Jan 2, 2020

Setting startup smoothing to zero would also solve this problem. See #294

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants