File tree 1 file changed +3
-3
lines changed
1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change 1
1
<div align =" center " >
2
2
3
- # WebLLM: High-Performance In-Browser LLM Inference Engine
3
+ # WebLLM
4
4
5
5
[ ![ NPM Package] ( https://img.shields.io/badge/NPM_Package-Published-cc3534 )] ( https://www.npmjs.com/package/@mlc-ai/web-llm )
6
6
[ ![ "WebLLM Chat Deployed"] ( https://img.shields.io/badge/WebLLM_Chat-Deployed-%2332a852?logo=github )] ( https://chat.webllm.ai/ )
10
10
11
11
</div >
12
12
13
- WebLLM is a modular and customizable javascript package that directly
13
+ WebLLM is a ** high-performance in-browser LLM inference engine ** that directly
14
14
brings language model chats directly onto web browsers with hardware acceleration.
15
- ** Everything runs inside the browser with no server support and is accelerated with WebGPU.**
15
+ Everything runs inside the browser with no server support and is accelerated with WebGPU.
16
16
17
17
** WebLLM is fully compatible with [ OpenAI API] ( https://platform.openai.com/docs/api-reference/chat ) .**
18
18
That is, you can use the same OpenAI API on ** any open source models** locally, with functionalities
You can’t perform that action at this time.
0 commit comments