File tree 1 file changed +28
-0
lines changed
1 file changed +28
-0
lines changed Original file line number Diff line number Diff line change 96
96
}
97
97
` ` `
98
98
99
+ #### Mixtral
100
+
101
+ Mixtral is opensource and can be used via Cloudflare, Google Cloud, Azure or installed locally.
102
+
103
+ The simplest way to try Mixtral on your case is using [Groq Cloud](https://groq.com) which provides Mixtral access with GPT-like API:
104
+
105
+ Prerequisite:
106
+
107
+ * Install ` groq- sdk` package
108
+ * obtain ` GROQ_API_KEY ` from OpenAI
109
+ * set ` GROQ_API_KEY ` as environment variable
110
+
111
+ Sample Groq configuration with Mixtral model:
112
+
113
+ ` ` ` js
114
+ ai: {
115
+ request: async (messages ) => {
116
+ const chatCompletion = await groq .chat .completions .create ({
117
+ messages,
118
+ model: " mixtral-8x7b-32768" ,
119
+ });
120
+ return chatCompletion .choices [0 ]? .message ? .content || " " ;
121
+ }
122
+ }
123
+ ` ` `
124
+
125
+ > Groq also provides access to other opensource models like llama or gemma
126
+
99
127
#### Anthropic Claude
100
128
101
129
Prerequisite:
You can’t perform that action at this time.
0 commit comments