Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DDP Documentation Clarification #20647

Open
Unturned3 opened this issue Mar 15, 2025 · 0 comments
Open

DDP Documentation Clarification #20647

Unturned3 opened this issue Mar 15, 2025 · 0 comments
Labels
docs Documentation related needs triage Waiting to be triaged by maintainers

Comments

@Unturned3
Copy link

Unturned3 commented Mar 15, 2025

📚 Documentation

The documentation on DDP currently says:

Using DDP this way has a few disadvantages over torch.multiprocessing.spawn():

  1. All processes (including the main process) participate in training and have the updated state of the model and Trainer state.
  2. No multiprocessing pickle errors
  3. Easily scales to multi-node training

Are these meant to be advantages instead of disadvantages?

cc @lantiga @Borda

@Unturned3 Unturned3 added docs Documentation related needs triage Waiting to be triaged by maintainers labels Mar 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs Documentation related needs triage Waiting to be triaged by maintainers
Projects
None yet
Development

No branches or pull requests

1 participant