notforu777 commited on
Commit
e79abd0
·
verified ·
1 Parent(s): fd451a4

Card: quality-vs-size chart with Unsloth, AutoRound and ggml-org in the header

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +3 -1
  3. quality-vs-size-all.png +3 -0
.gitattributes CHANGED
@@ -41,3 +41,4 @@ mmproj-embeddinggemma-2-BF16.gguf filter=lfs diff=lfs merge=lfs -text
41
  mmproj-embeddinggemma-2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
42
  quality-vs-size.png filter=lfs diff=lfs merge=lfs -text
43
  bits-by-layer.png filter=lfs diff=lfs merge=lfs -text
 
 
41
  mmproj-embeddinggemma-2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
42
  quality-vs-size.png filter=lfs diff=lfs merge=lfs -text
43
  bits-by-layer.png filter=lfs diff=lfs merge=lfs -text
44
+ quality-vs-size-all.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -32,7 +32,7 @@ tags:
32
  </ul>
33
  <hr style="margin: 0 0 16px 0;">
34
 
35
- ![Same-size comparison of AtomicChat, AutoRound and Unsloth files](quality-vs-size.png)
36
 
37
  At the same size our files' vectors stay closest to the original's: 17% closer
38
  than the next best file at about 245 MB, and 11% closer at about 175 MB. The
@@ -158,6 +158,8 @@ We downloaded the other publishers' files and measured them with the same
158
  harness, the same eval set and the same machine. `1 - cosine` is the mean
159
  distance of a file's vectors from the original's: lower is better.
160
 
 
 
161
  | File | Size | same top result | 1 - cosine, 30 languages | 1 - cosine, code |
162
  |---|---:|---:|---:|---:|
163
  | Unsloth `UD-Q6_K_XL` | 249 MB | 97.0% | 0.00080 | 0.00061 |
 
32
  </ul>
33
  <hr style="margin: 0 0 16px 0;">
34
 
35
+ ![Quality against size: AtomicChat, Unsloth, AutoRound and ggml-org](quality-vs-size-all.png)
36
 
37
  At the same size our files' vectors stay closest to the original's: 17% closer
38
  than the next best file at about 245 MB, and 11% closer at about 175 MB. The
 
158
  harness, the same eval set and the same machine. `1 - cosine` is the mean
159
  distance of a file's vectors from the original's: lower is better.
160
 
161
+ ![Same-size comparison of AtomicChat, AutoRound and Unsloth files](quality-vs-size.png)
162
+
163
  | File | Size | same top result | 1 - cosine, 30 languages | 1 - cosine, code |
164
  |---|---:|---:|---:|---:|
165
  | Unsloth `UD-Q6_K_XL` | 249 MB | 97.0% | 0.00080 | 0.00061 |
quality-vs-size-all.png ADDED

Git LFS Details

  • SHA256: c17edf22bb2477b15490ab4f008ef6a27e07e6a911b7564957f002cb62504d4c
  • Pointer size: 131 Bytes
  • Size of remote file: 150 kB