|
21 | 21 |
|
22 | 22 | | Model | Version | Huggingface Link |
|
23 | 23 | | --- | --- | --- |
|
24 |
| -| llama3 | 70b-instruct-awq-4bit-3948 | [HF Link](https://huggingface.co/casperhansen/llama-3-70b-instruct-awq) | |
25 |
| -| llama3 | 70b-instruct-fp16-8678 | [HF Link](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) | |
26 |
| -| llama3 | 8b-instruct-awq-4bit-f711 | [HF Link](https://huggingface.co/casperhansen/llama-3-8b-instruct-awq) | |
27 |
| -| llama3 | 8b-instruct-fp16-46f3 | [HF Link](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | |
| 24 | +| llama3 | 70b-instruct-awq-4bit-a5d5 | [HF Link](https://huggingface.co/casperhansen/llama-3-70b-instruct-awq) | |
| 25 | +| llama3 | 70b-instruct-fp16-d0d4 | [HF Link](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) | |
| 26 | +| llama3 | 8b-instruct-awq-4bit-e780 | [HF Link](https://huggingface.co/casperhansen/llama-3-8b-instruct-awq) | |
| 27 | +| llama3 | 8b-instruct-fp16-0083 | [HF Link](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) | |
28 | 28 |
|
29 | 29 | ---
|
30 | 30 |
|
|
33 | 33 |
|
34 | 34 | | Model | Version | Huggingface Link |
|
35 | 35 | | --- | --- | --- |
|
36 |
| -| phi3 | 3.8b-instruct-fp16-a912 | [HF Link](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) | |
37 |
| -| phi3 | 3.8b-instruct-ggml-q4-6139 | [HF Link](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf) | |
| 36 | +| phi3 | 3.8b-instruct-fp16-07bf | [HF Link](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) | |
| 37 | +| phi3 | 3.8b-instruct-ggml-q4-584f | [HF Link](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-gguf) | |
38 | 38 |
|
39 | 39 | ---
|
40 | 40 |
|
|
43 | 43 |
|
44 | 44 | | Model | Version | Huggingface Link |
|
45 | 45 | | --- | --- | --- |
|
46 |
| -| mistral | 7b-instruct-awq-4bit-2a5e | [HF Link](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-AWQ) | |
47 |
| -| mistral | 7b-instruct-fp16-e205 | [HF Link](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) | |
| 46 | +| mistral | 7b-instruct-awq-4bit-33ce | [HF Link](https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-AWQ) | |
| 47 | +| mistral | 7b-instruct-fp16-fe78 | [HF Link](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) | |
48 | 48 |
|
49 | 49 | ---
|
50 | 50 |
|
|
53 | 53 |
|
54 | 54 | | Model | Version | Huggingface Link |
|
55 | 55 | | --- | --- | --- |
|
56 |
| -| qwen2 | 0.5b-instruct-fp16-855c | [HF Link](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) | |
57 |
| -| qwen2 | 1.5b-instruct-fp16-3346 | [HF Link](https://huggingface.co/Qwen/Qwen2-1.5B-Instruct) | |
58 |
| -| qwen2 | 57b-a14b-instruct-fp16-8d40 | [HF Link](https://huggingface.co/Qwen/Qwen2-57B-A14B-Instruct) | |
59 |
| -| qwen2 | 72b-instruct-awq-4bit-177e | [HF Link](https://huggingface.co/Qwen/Qwen2-72B-Instruct-AWQ) | |
60 |
| -| qwen2 | 72b-instruct-fp16-e6e1 | [HF Link](https://huggingface.co/Qwen/Qwen2-72B-Instruct) | |
61 |
| -| qwen2 | 7b-instruct-awq-4bit-77be | [HF Link](https://huggingface.co/Qwen/Qwen2-7B-Instruct-AWQ) | |
62 |
| -| qwen2 | 7b-instruct-fp16-9381 | [HF Link](https://huggingface.co/Qwen/Qwen2-7B-Instruct) | |
| 56 | +| qwen2 | 0.5b-instruct-fp16-96bb | [HF Link](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) | |
| 57 | +| qwen2 | 1.5b-instruct-fp16-ec69 | [HF Link](https://huggingface.co/Qwen/Qwen2-1.5B-Instruct) | |
| 58 | +| qwen2 | 57b-a14b-instruct-fp16-f63b | [HF Link](https://huggingface.co/Qwen/Qwen2-57B-A14B-Instruct) | |
| 59 | +| qwen2 | 72b-instruct-awq-4bit-f44a | [HF Link](https://huggingface.co/Qwen/Qwen2-72B-Instruct-AWQ) | |
| 60 | +| qwen2 | 72b-instruct-fp16-8d53 | [HF Link](https://huggingface.co/Qwen/Qwen2-72B-Instruct) | |
| 61 | +| qwen2 | 7b-instruct-awq-4bit-6b70 | [HF Link](https://huggingface.co/Qwen/Qwen2-7B-Instruct-AWQ) | |
| 62 | +| qwen2 | 7b-instruct-fp16-805b | [HF Link](https://huggingface.co/Qwen/Qwen2-7B-Instruct) | |
63 | 63 |
|
64 | 64 | ---
|
65 | 65 |
|
|
68 | 68 |
|
69 | 69 | | Model | Version | Huggingface Link |
|
70 | 70 | | --- | --- | --- |
|
71 |
| -| gemma | 2b-instruct-fp16-da36 | [HF Link](https://huggingface.co/google/gemma-2b-it) | |
72 |
| -| gemma | 7b-instruct-awq-4bit-6a74 | [HF Link](https://huggingface.co/casperhansen/gemma-7b-it-awq) | |
73 |
| -| gemma | 7b-instruct-fp16-dafc | [HF Link](https://huggingface.co/google/gemma-7b-it) | |
| 71 | +| gemma | 2b-instruct-fp16-26b3 | [HF Link](https://huggingface.co/google/gemma-2b-it) | |
| 72 | +| gemma | 7b-instruct-awq-4bit-d670 | [HF Link](https://huggingface.co/casperhansen/gemma-7b-it-awq) | |
| 73 | +| gemma | 7b-instruct-fp16-ae3e | [HF Link](https://huggingface.co/google/gemma-7b-it) | |
74 | 74 |
|
75 | 75 | ---
|
76 | 76 |
|
|
79 | 79 |
|
80 | 80 | | Model | Version | Huggingface Link |
|
81 | 81 | | --- | --- | --- |
|
82 |
| -| llama2 | 13b-chat-fp16-0b04 | [HF Link](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) | |
83 |
| -| llama2 | 70b-chat-fp16-4512 | [HF Link](https://huggingface.co/meta-llama/Llama-2-70b-chat-hf) | |
84 |
| -| llama2 | 7b-chat-awq-4bit-dcbf | [HF Link](https://huggingface.co/TheBloke/Llama-2-7B-Chat-AWQ) | |
85 |
| -| llama2 | 7b-chat-fp16-d960 | [HF Link](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) | |
| 82 | +| llama2 | 13b-chat-fp16-4059 | [HF Link](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) | |
| 83 | +| llama2 | 70b-chat-fp16-b0de | [HF Link](https://huggingface.co/meta-llama/Llama-2-70b-chat-hf) | |
| 84 | +| llama2 | 7b-chat-awq-4bit-a35d | [HF Link](https://huggingface.co/TheBloke/Llama-2-7B-Chat-AWQ) | |
| 85 | +| llama2 | 7b-chat-fp16-f9ef | [HF Link](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) | |
86 | 86 |
|
87 | 87 | ---
|
88 | 88 |
|
|
91 | 91 |
|
92 | 92 | | Model | Version | Huggingface Link |
|
93 | 93 | | --- | --- | --- |
|
94 |
| -| mixtral | 8x7b-instruct-v0.1-awq-4bit-32eb | [HF Link](https://huggingface.co/casperhansen/mixtral-instruct-awq) | |
95 |
| -| mixtral | 8x7b-instruct-v0.1-fp16-d01a | [HF Link](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) | |
| 94 | +| mixtral | 8x7b-instruct-v0.1-awq-4bit-0016 | [HF Link](https://huggingface.co/casperhansen/mixtral-instruct-awq) | |
| 95 | +| mixtral | 8x7b-instruct-v0.1-fp16-b90a | [HF Link](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) | |
96 | 96 |
|
97 | 97 | ---
|
98 | 98 |
|
0 commit comments