Search⌘ K
AI Features

SummaryWriter

Explore how to use PyTorch's SummaryWriter to create meaningful logs for TensorBoard. Learn to set up organized log directories, add model graphs, and track training and validation losses over epochs. Understand best practices for managing multiple runs to avoid corrupted visualizations and enhance model training insights.

Overview of SummaryWriter

It all starts with the creation of a SummaryWriter:

Python 3.5
# setting SummaryWriter up
writer = SummaryWriter('runs/test')

If we try printing this, we get the following output:

Python 3.5
# setting SummaryWriter up
writer = SummaryWriter('runs/test')
print(writer)

Since we told TensorBoard to look for logs inside the runs folder, it only makes sense to actually log to that folder. Moreover, to be able to distinguish between different experiments or models, we should also specify a sub-folder: test.





...

If we do not specify any folder, TensorBoard will default to runs/CURRENT_DATETIME_HOSTNAME, which is not such a great name if you are looking for your experiment results in the future.

So, it is recommended to try to name it in a more meaningful way like runs/test or runs/simple_linear_regression. It will then create a subfolder inside runs (the folder we specified when we started TensorBoard).

Even better, you should name it i ...

Ask