Skip to content

Commit 64f3be7

Browse files
authored
Added mixtral instructions to AI
1 parent 56a54c1 commit 64f3be7

File tree

1 file changed

+28
-0
lines changed

1 file changed

+28
-0
lines changed

Diff for: docs/ai.md

+28
Original file line numberDiff line numberDiff line change
@@ -96,6 +96,34 @@ ai: {
9696
}
9797
```
9898
99+
#### Mixtral
100+
101+
Mixtral is opensource and can be used via Cloudflare, Google Cloud, Azure or installed locally.
102+
103+
The simplest way to try Mixtral on your case is using [Groq Cloud](https://groq.com) which provides Mixtral access with GPT-like API:
104+
105+
Prerequisite:
106+
107+
* Install `groq-sdk` package
108+
* obtain `GROQ_API_KEY` from OpenAI
109+
* set `GROQ_API_KEY` as environment variable
110+
111+
Sample Groq configuration with Mixtral model:
112+
113+
```js
114+
ai: {
115+
request: async (messages) => {
116+
const chatCompletion = await groq.chat.completions.create({
117+
messages,
118+
model: "mixtral-8x7b-32768",
119+
});
120+
return chatCompletion.choices[0]?.message?.content || "";
121+
}
122+
}
123+
```
124+
125+
> Groq also provides access to other opensource models like llama or gemma
126+
99127
#### Anthropic Claude
100128
101129
Prerequisite:

0 commit comments

Comments
 (0)