-
-
Notifications
You must be signed in to change notification settings - Fork 7.7k
[Bugfix] Added embed_is_patch
mask for fuyu model
#15731
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Kyle Huang <[email protected]>
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
Signed-off-by: Kyle Huang <[email protected]> Signed-off-by: Kyle Sayers <[email protected]>
Signed-off-by: Kyle Huang <[email protected]> Signed-off-by: xinyuxiao <[email protected]>
Signed-off-by: Kyle Huang <[email protected]> Signed-off-by: Louis Ulmer <[email protected]>
SUMMARY: upstream sync to `bb103b29bf3d26fa831458a8ca5af1bb820c4712` this is as of 2025-03-30 Boston AM. ```bash > git log commit f44d253 (HEAD -> upstreamsync-20250330, origin/upstreamsync-20250330) Merge: 2602d9d bb103b2 Author: andy-neuma <[email protected]> Date: Sun Mar 30 11:17:52 2025 -0400 Merge remote-tracking branch 'upstream/main' commit bb103b2 (upstream/main) Author: kYLe <[email protected]> Date: Sun Mar 30 05:45:08 2025 -0500 [Bugfix] Added `embed_is_patch` mask for fuyu model (vllm-project#15731) Signed-off-by: Kyle Huang <[email protected]> ... ``` created via "merge" not cherry-pick TEST PLAN: accept sync is green - https://github.com/neuralmagic/nm-cicd/actions/runs/14225725956
Signed-off-by: Kyle Huang <[email protected]>
Signed-off-by: Kyle Huang <[email protected]>
Signed-off-by: Kyle Huang <[email protected]>
Signed-off-by: Kyle Huang <[email protected]> Signed-off-by: Mu Huai <[email protected]>
Address issue #15144 for Fuyu model.
Added
embed_is_patch
mask in the format oftorch.tensor(([True] * ncols + [False]) * nrows)
( Fuyu had newline for each row according to this)