Skip to content

💡 [REQUEST] - Port TorchRL Pendulum tutorial from pytorch.org/rl to pytorch.org/tutorials #2352

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
vmoens opened this issue May 26, 2023 · 4 comments · Fixed by #2653
Closed

Comments

@vmoens
Copy link
Contributor

vmoens commented May 26, 2023

🚀 Descirbe the improvement or the new tutorial

For historical reasons, TorchRL privately hosts a bunch of tutorials.
We'd like to bring the most significant ones to pytorch tutorials for more visibility.

Here is the tutorial.

Environments (or simulators) are a core part of many RL algorithms. The OpenAI Gym API has had a great success in the past years and paved the way for RL researchers to quickly test ideas with an easy-to-use tool.
As a PyTorch-first library, torchrl aims at being (1) oblivious to the simulator (gym or other), (2) rely on pytorch for anything we can in the simulation process, (3) a good integration within the library and (4) a coverage of many different types of environments (simulators, real-life hardware, model-based, RLHF etc). For these reasons, TorchRL propose its own class of environments. We have a dedicated tutorial that covers their design and usage: you can help us port it where it belongs!

Steps:

  1. Port the tutorial from the RL repo to the tutorials repo.
  2. Fix any formatting issues or typos.
  3. Make sure the tutorial follows the tutorial template (template_tutorial.py)
  4. Preserve the original author

Existing tutorials on this topic

No response

Additional context

The tutorial should not require extra dependencies beyond those already present in requirements.txt

cc @nairbv @sekyondaMeta @svekars @carljparker @NicolasHug @kit1980 @subramen @jgong5 @mingfeima @XiaobingSuper @sanchitintel @ashokei @jingxu10 @ZailiWang @ZhaoqiongZ @leslie-fang-intel @Xia-Weiwen @sekahler2 @CaoE @zhuhaozhe @Valentine233

@svekars svekars added intel rl medium docathon-h1-2023 A label for the docathon in H1 2023 and removed intel labels May 30, 2023
@Samsonboadi
Copy link
Contributor

/Assigntome

@svekars
Copy link
Contributor

svekars commented Oct 24, 2023

This issue has been unassigned due to inactivity. If you are still planning to work on this, you can still send a PR referencing this issue.

@svekars svekars added docathon-h2-2023 and removed docathon-h1-2023 A label for the docathon in H1 2023 labels Oct 30, 2023
@IvanLauLinTiong
Copy link

/assigntome

@IvanLauLinTiong IvanLauLinTiong removed their assignment Nov 5, 2023
@krishnakalyan3
Copy link
Contributor

/assigntome

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
5 participants