Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,8 @@ tags:
|
|
| 9 |
|
| 10 |
EXL3 quants of [Muse-Glimmer-30B-assistant](https://huggingface.co/meta-models/Muse-Glimmer-30B-assistant)
|
| 11 |
|
|
|
|
|
|
|
| 12 |
[2.00 bits per weight](https://huggingface.co/turboderp/Muse-Glimmer-30B-assistant-exl3/tree/2.50bpw)
|
| 13 |
[3.00 bits per weight](https://huggingface.co/turboderp/Muse-Glimmer-30B-assistant-exl3/tree/3.00bpw)
|
| 14 |
[4.00 bits per weight](https://huggingface.co/turboderp/Muse-Glimmer-30B-assistant-exl3/tree/4.00bpw)
|
|
|
|
| 9 |
|
| 10 |
EXL3 quants of [Muse-Glimmer-30B-assistant](https://huggingface.co/meta-models/Muse-Glimmer-30B-assistant)
|
| 11 |
|
| 12 |
+
⚠️ Needs ExLlamav3 v1.4.2 (or dev branch)
|
| 13 |
+
|
| 14 |
[2.00 bits per weight](https://huggingface.co/turboderp/Muse-Glimmer-30B-assistant-exl3/tree/2.50bpw)
|
| 15 |
[3.00 bits per weight](https://huggingface.co/turboderp/Muse-Glimmer-30B-assistant-exl3/tree/3.00bpw)
|
| 16 |
[4.00 bits per weight](https://huggingface.co/turboderp/Muse-Glimmer-30B-assistant-exl3/tree/4.00bpw)
|