Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] AWS ChatBedrock throwing error with claude 3.7 sonnet model #4253

Open
SSW50 opened this issue Apr 4, 2025 · 1 comment
Open

[BUG] AWS ChatBedrock throwing error with claude 3.7 sonnet model #4253

SSW50 opened this issue Apr 4, 2025 · 1 comment
Labels
question Further information is requested

Comments

@SSW50
Copy link

SSW50 commented Apr 4, 2025

Describe the bug
AWS ChatBedrock gives error when using with claude 3.7 sonnet model

Image

[llm/error] [1:chain:RunnableSequence > 5:llm:BedrockChat] [733ms] LLM run errored with error: "Invocation of model ID anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.\n\nValidationException: Invocation of model ID anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.\n at de_ValidationExceptionRes (/home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1690:21)\n at de_CommandError (/home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1507:19)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/middleware-serde/dist-cjs/index.js:35:20\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/core/dist-cjs/index.js:167:18\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/middleware-retry/dist-cjs/index.js:321:38\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:33:22\n at async BedrockChat.streamResponseChunks (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected]@langchain[email protected][email protected]_encoding@[email protected]_bufferuti_qp2f2yzbv2jlr3q5f4girn3fka/node_modules/@langchain/aws/dist/chat_models.cjs:695:26)\n at async BedrockChat.generate (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected]@langchain[email protected][email protected]_encoding@[email protected]_bufferuti_qp2f2yzbv2jlr3q5f4girn3fka/node_modules/@langchain/aws/dist/chat_models.cjs:638:30)\n at async Promise.allSettled (index 0)\n at async BedrockChat.generateUncached (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/@langchain/core/dist/language_models/chat_models.cjs:227:29)\n at async BedrockChat.invoke (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]_/node_modules/@langchain/core/dist/language_models/chat_models.cjs:65:24)\n at async RunnableSequence.invoke (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]_/node_modules/@langchain/core/dist/runnables/base.cjs:1285:33)\n at async ConversationChain_Chains.run (/home/flowise-ai/devflownew/packages/components/dist/nodes/chains/ConversationChain/ConversationChain.js:111:19)\n at async executeFlow (/home/flowise-ai/devflownew/packages/server/dist/utils/buildChatflow.js:490:22)\n at async utilBuildChatflow (/home/flowise-ai/devflownew/packages/server/dist/utils/buildChatflow.js:695:28)"

To Reproduce
Steps to reproduce the behavior:
Create chatflow with AWS ChatBedrock and use the model claude 3.7 sonnet

Expected behavior
A proper response instead of error

Screenshots

Image

Setup

  • Flowise Version 2.2.7-patch.1
@HenryHengZJ
Copy link
Contributor

Not sure if this is from Flowise side, can you even access the model outside of Flowise?

@HenryHengZJ HenryHengZJ added the question Further information is requested label Apr 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants