Fix Q4_1_O optimization

RWKV · Apr 18, 2023 · 7b28076 · 7b28076
1 parent 2ef7ee0
commit 7b28076
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 2 deletions.
diff --git a/README.md b/README.md
@@ -90,7 +90,7 @@ python rwkv/quantize.py ~/Downloads/rwkv.cpp-169M.bin ~/Downloads/rwkv.cpp-169M-
 
 Formats available:
 
-- `4`: `Q4_1_O`, OK quality, fast (comparable to `FP16`).
+- `4`: `Q4_1_O`, OK quality, moderately fast (20% slower than `FP16`).
 - `3`: `Q4_1`, worst quality, fast (comparable to `FP16`).
 - `2`: `Q4_0`, poor quality, very fast.
 

diff --git a/ggml b/ggml