基于OpenGL计算着色器的常见大模型推理(目前已支持llama2和rwkv4)
-
Updated
Jan 7, 2024 - C
基于OpenGL计算着色器的常见大模型推理(目前已支持llama2和rwkv4)
Support for running RWKV 4/5 World models locally from the command line for conversation and small talk. Support is provided through the prompt.txt defines the prompt for the model. Support Mirostat algorithm and traditional Top-k, Top-p for decoding.
JNI wrapper for rwkv.cpp
A repository to deploy RWKV model to serverless APIs such as Runpod.io
Local Web-UI sandbox for AI-powered storybuilding with friends.
RWKV Wiki website (archived, please visit official wiki)
使用 rwkv 架構的大型語言模型運作的 Discord 聊天機器人,擁有辨識維基百科條目名並將其當作關鍵字抽取出的能力,並且還會將此關鍵字用於爬取維基百科,並將條目內容回傳給自身參考。
用户友好、开箱即用的 RWKV Prompts 示例,适用于所有用户。Awesome RWKV Prompts for general users, more user-friendly, ready-to-use prompt examples.
Add a description, image, and links to the rwkv topic page so that developers can more easily learn about it.
To associate your repository with the rwkv topic, visit your repo's landing page and select "manage topics."