Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add RWKV v5.1 and v5.2 support (#145)
* Reformat CMakeLists and docs * Add RWKV v5.1 and v5.2 support * Remove sequence_length-based heuristic for allocating ggml context * Set GGML_CUDA_MMV_Y to 2 by default * Clarify comment; update ggml * Make some operations inplace * Make some operations inplace * Add late_abort option for tests * Increase thresholds * Increase thresholds * Update README.md
- Loading branch information
1 parent
22a2778
commit 20a8549
Showing
38 changed files
with
743 additions
and
219 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Submodule ggml
updated
from d925ed to 4b20bb
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.