Distributed Data Parallel Tutorial UX improvement suggestion

[HDCharles]

referring to the tutorial: https://pytorch.org/tutorials/intermediate/ddp_tutorial.html

Though the tutorial is broken down into sections, it doesn't show how to actually run the code from each section until the very end of the tutorial.

The code as presented in each section only gives function definitions despite the tutorial text carrying on as though the user is supposed to be able to see something from running the code snippet that has been provided. This combination of info presented in a way that seems self contained, with code that seems self contained but isn't was rather confusing.

to remedy this issue I think it'd make things easier if either
A) the code to run each section is included in that code snippet
B) a notebook is included in the tutorial so users can see how the code is actually run, without having to guess/find that this code is only listed at the bottom of the tutorial
C) mention that a reasonable default set to run the code snippets can be found at the bottom of the tutorial.

additional data point: Before I noticed the code at the bottom of the tutorial to invoke the functions, I looked for other resources and came across an external tutorial: https://yangkky.github.io/2019/07/08/distributed-pytorch-tutorial.html which specifically references the pytorch DDP tutorial and raises similar criticism. Though some of the flaws pointed out have been fixed, this piece remains

cc @sekyondaMeta @svekars @carljparker @NicolasHug @kit1980 @subramen

[Samsonboadi]

/assigntome

[Samsonboadi]

@svekars where is the sources file for this issue so I can address it? Is this relevant? because I dont see any link to the source file here

[HDCharles]

@Samsonboadi

https://github.com/pytorch/tutorials/blob/main/intermediate_source/ddp_tutorial.rst

[svekars]

This issue has been unassigned due to inactivity. If you are still planning to work on this, you can still send a PR referencing this issue.

[JoseLuisC99]

/assigntome

[svekars]

@JoseLuisC99 - glad to see you again! Can you please tell me which of the tasks assigned to you are you working on at the moment? You have three tasks assigned to you and I want to make sure others get a chance to participate as well.

[JoseLuisC99]

Hi! Ok, I will focus on #2345

[ma7dev]

/assigntome

[gao-hongnan]

/assigntome

[github-actions]

The issue is already assigned. Please pick an opened and unnasigned issue with the docathon-h2-2023 label.