Skip to content

[ET-VK] Changing all conv 2d pw ints from uint16 to int since it slightly improves perf. #7545

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

trivedivivek
Copy link
Contributor

@trivedivivek trivedivivek commented Jan 7, 2025

Stack from ghstack (oldest at bottom):

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.

Differential Revision: D67906023

…htly improves perf.

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

[ghstack-poisoned]
Copy link

pytorch-bot bot commented Jan 7, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/7545

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 0cfd4a5 with merge base 39e8538 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 7, 2025
trivedivivek added a commit that referenced this pull request Jan 7, 2025
…htly improves perf.

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

ghstack-source-id: 260513229
Pull Request resolved: #7545
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D67906023

…nce it slightly improves perf."

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D67906023

trivedivivek added a commit that referenced this pull request Jan 8, 2025
…htly improves perf.

Pull Request resolved: #7545

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)
ghstack-source-id: 260637199
…nce it slightly improves perf."

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D67906023

trivedivivek added a commit that referenced this pull request Jan 9, 2025
…htly improves perf.

Pull Request resolved: #7545

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.
ghstack-source-id: 260707857

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)
@facebook-github-bot facebook-github-bot merged commit eeffa26 into gh/trivedivivek/39/base Jan 9, 2025
46 checks passed
@facebook-github-bot facebook-github-bot deleted the gh/trivedivivek/39/head branch January 9, 2025 06:47
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D67906023

trivedivivek added a commit that referenced this pull request Jan 9, 2025
…htly improves perf. (#7566)

* [ET-VK] Adding a common utility function to calculate 3d output position based on unique index.

Pull Request resolved: #7522

This diff adds an indexing utils header file used in Vulkan backend of Executorch. The header file includes functions for converting a global index to u16 indices based on input sizes.
ghstack-source-id: 260707858
@exported-using-ghexport

Differential Revision: [D67821941](https://our.internmc.facebook.com/intern/diff/D67821941/)

* [ET-VK] Adding batch processing in x axis to conv2d dw shader by caching input texel for reuse.

Pull Request resolved: #7526

This diff adds batch processing in the x axis to the conv2d dw shader by reusing input texel overlapping between consecutive tiles. The changes include modifying the glsl code for the conv2d dw output tile, adding a new parameter to the yaml file, and modifying the Convolution.cpp file to use the new parameter.
ghstack-source-id: 260707856

Differential Revision: [D67868671](https://our.internmc.facebook.com/intern/diff/D67868671/)

* [ET-VK] Changing all conv 2d pw ints from uint16 to int since it slightly improves perf.

Pull Request resolved: #7545

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.
ghstack-source-id: 260707857

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

---------

Co-authored-by: Vivek Trivedi <[email protected]>
@lucylq lucylq mentioned this pull request Jan 15, 2025
YIWENX14 pushed a commit that referenced this pull request Jan 28, 2025
…htly improves perf. (#7566)

* [ET-VK] Adding a common utility function to calculate 3d output position based on unique index.

Pull Request resolved: #7522

This diff adds an indexing utils header file used in Vulkan backend of Executorch. The header file includes functions for converting a global index to u16 indices based on input sizes.
ghstack-source-id: 260707858
@exported-using-ghexport

Differential Revision: [D67821941](https://our.internmc.facebook.com/intern/diff/D67821941/)

* [ET-VK] Adding batch processing in x axis to conv2d dw shader by caching input texel for reuse.

Pull Request resolved: #7526

This diff adds batch processing in the x axis to the conv2d dw shader by reusing input texel overlapping between consecutive tiles. The changes include modifying the glsl code for the conv2d dw output tile, adding a new parameter to the yaml file, and modifying the Convolution.cpp file to use the new parameter.
ghstack-source-id: 260707856

Differential Revision: [D67868671](https://our.internmc.facebook.com/intern/diff/D67868671/)

* [ET-VK] Changing all conv 2d pw ints from uint16 to int since it slightly improves perf.

Pull Request resolved: #7545

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.
ghstack-source-id: 260707857

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

---------

Co-authored-by: Vivek Trivedi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported topic: not user facing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants