Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The linked Huging Face page in the README doesn't have any .bin files #159

Closed
krikru opened this issue Jan 26, 2024 · 1 comment · Fixed by #160
Closed

The linked Huging Face page in the README doesn't have any .bin files #159

krikru opened this issue Jan 26, 2024 · 1 comment · Fixed by #160

Comments

@krikru
Copy link

krikru commented Jan 26, 2024

Under "Option 3.1. Download pre-quantized Raven model" in README.md, the instructions tell you to "check that you are downloading .bin file, not .pth," but on the linked page, there are .pth files but no .bin files.

@saharNooby saharNooby linked a pull request Jan 26, 2024 that will close this issue
@saharNooby
Copy link
Collaborator

Blink does not provide pre-quantized models for rwkv.cpp anymore, so I've removed the section.

I'm not comfortable officially recommending third-party pre-quantized models on Hugging Face, and instead recommend to do the conversion yourself.

However, looks like latestissue on Hugging Face has uploaded all RWKV models in all available formats -- you may find these useful, but use them at your own risk.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants