You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
AWS ChatBedrock gives error when using with claude 3.7 sonnet model
[llm/error] [1:chain:RunnableSequence > 5:llm:BedrockChat] [733ms] LLM run errored with error: "Invocation of model ID anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.\n\nValidationException: Invocation of model ID anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.\n at de_ValidationExceptionRes (/home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1690:21)\n at de_CommandError (/home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1507:19)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/middleware-serde/dist-cjs/index.js:35:20\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/core/dist-cjs/index.js:167:18\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/middleware-retry/dist-cjs/index.js:321:38\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:33:22\n at async BedrockChat.streamResponseChunks (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected]@langchain[email protected][email protected]_encoding@[email protected]_bufferuti_qp2f2yzbv2jlr3q5f4girn3fka/node_modules/@langchain/aws/dist/chat_models.cjs:695:26)\n at async BedrockChat.generate (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected]@langchain[email protected][email protected]_encoding@[email protected]_bufferuti_qp2f2yzbv2jlr3q5f4girn3fka/node_modules/@langchain/aws/dist/chat_models.cjs:638:30)\n at async Promise.allSettled (index 0)\n at async BedrockChat.generateUncached (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/@langchain/core/dist/language_models/chat_models.cjs:227:29)\n at async BedrockChat.invoke (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]_/node_modules/@langchain/core/dist/language_models/chat_models.cjs:65:24)\n at async RunnableSequence.invoke (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]_/node_modules/@langchain/core/dist/runnables/base.cjs:1285:33)\n at async ConversationChain_Chains.run (/home/flowise-ai/devflownew/packages/components/dist/nodes/chains/ConversationChain/ConversationChain.js:111:19)\n at async executeFlow (/home/flowise-ai/devflownew/packages/server/dist/utils/buildChatflow.js:490:22)\n at async utilBuildChatflow (/home/flowise-ai/devflownew/packages/server/dist/utils/buildChatflow.js:695:28)"
To Reproduce
Steps to reproduce the behavior:
Create chatflow with AWS ChatBedrock and use the model claude 3.7 sonnet
Expected behavior
A proper response instead of error
Screenshots
Setup
Flowise Version 2.2.7-patch.1
The text was updated successfully, but these errors were encountered:
Describe the bug
AWS ChatBedrock gives error when using with claude 3.7 sonnet model
[llm/error] [1:chain:RunnableSequence > 5:llm:BedrockChat] [733ms] LLM run errored with error: "Invocation of model ID anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.\n\nValidationException: Invocation of model ID anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.\n at de_ValidationExceptionRes (/home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1690:21)\n at de_CommandError (/home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/client-bedrock-runtime/dist-cjs/index.js:1507:19)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/middleware-serde/dist-cjs/index.js:35:20\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/core/dist-cjs/index.js:167:18\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@smithy[email protected]/node_modules/@smithy/middleware-retry/dist-cjs/index.js:321:38\n at async /home/flowise-ai/devflownew/node_modules/.pnpm/@AWS-SDK[email protected]/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:33:22\n at async BedrockChat.streamResponseChunks (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected]@langchain[email protected][email protected]_encoding@[email protected]_bufferuti_qp2f2yzbv2jlr3q5f4girn3fka/node_modules/@langchain/aws/dist/chat_models.cjs:695:26)\n at async BedrockChat.generate (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected]@langchain[email protected][email protected]_encoding@[email protected]_bufferuti_qp2f2yzbv2jlr3q5f4girn3fka/node_modules/@langchain/aws/dist/chat_models.cjs:638:30)\n at async Promise.allSettled (index 0)\n at async BedrockChat.generateUncached (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]/node_modules/@langchain/core/dist/language_models/chat_models.cjs:227:29)\n at async BedrockChat.invoke (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]_/node_modules/@langchain/core/dist/language_models/chat_models.cjs:65:24)\n at async RunnableSequence.invoke (/home/flowise-ai/devflownew/node_modules/.pnpm/@langchain[email protected][email protected][email protected][email protected][email protected][email protected][email protected]_/node_modules/@langchain/core/dist/runnables/base.cjs:1285:33)\n at async ConversationChain_Chains.run (/home/flowise-ai/devflownew/packages/components/dist/nodes/chains/ConversationChain/ConversationChain.js:111:19)\n at async executeFlow (/home/flowise-ai/devflownew/packages/server/dist/utils/buildChatflow.js:490:22)\n at async utilBuildChatflow (/home/flowise-ai/devflownew/packages/server/dist/utils/buildChatflow.js:695:28)"
To Reproduce
Steps to reproduce the behavior:
Create chatflow with AWS ChatBedrock and use the model claude 3.7 sonnet
Expected behavior
A proper response instead of error
Screenshots
Setup
The text was updated successfully, but these errors were encountered: