Skip to content

Support Habanas' Gaudi Accelerator #10214

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
SeanNaren opened this issue Oct 28, 2021 · 1 comment · Fixed by #11808
Closed

Support Habanas' Gaudi Accelerator #10214

SeanNaren opened this issue Oct 28, 2021 · 1 comment · Fixed by #11808
Assignees
@kaushikb11
Labels
feature Is an improvement or enhancement help wanted Open to be worked on
Milestone
pl:1.6

Comments

@SeanNaren
Copy link
Contributor

SeanNaren commented Oct 28, 2021 •
edited by github-actions bot
Loading

🚀 Feature

Recently Intel's Habana Labs announced AWS nodes for their Gaudi Accelerator. As described in the reddit post there seems to be a lot of potential for model parallel solution that require fast interconnect between processors.

Looking at the pytorch migration guide there is room for lightning to assist in making this process seamless, helping users to not have to worry about this details (especially around the KCRS -> RSCK format for convolutions).

I suggest we introduce a new accelerator type such that we can enable this in lightning through the accelerator flag, i.e:

trainer = Trainer(accelerator='hpu')

HPU is what the accelerator seems to be called within the migration guide.

cc @Borda
@SeanNaren SeanNaren added feature Is an improvement or enhancement help wanted Open to be worked on labels Oct 28, 2021
@kaushikb11 kaushikb11 mentioned this issue Nov 8, 2021
Closed
12 tasks
@stale stale bot added the won't fix This will not be worked on label Dec 1, 2021
@Borda Borda added this to the 1.7 milestone Dec 1, 2021
@stale stale bot removed the won't fix This will not be worked on label Dec 1, 2021
@Lightning-AI Lightning-AI deleted a comment from stale bot Dec 1, 2021
@carmocca carmocca moved this to In Progress in Frameworks Planning Feb 14, 2022
@carmocca carmocca mentioned this issue Feb 16, 2022
Merged
12 tasks
@Borda
Copy link
Member

Borda commented Mar 7, 2022

just for the record: #12258 and #12200

Repository owner moved this from In Progress to Done in Frameworks Planning Mar 25, 2022
@carmocca carmocca modified the milestones: 1.7, 1.6 Mar 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kaushikb11 kaushikb11

Labels
feature Is an improvement or enhancement help wanted Open to be worked on
Projects
No open projects
Frameworks Planning
Status: Done
Milestone
pl:1.6
4 participants
@Borda @SeanNaren @carmocca @kaushikb11