Skip to content

master-39ed572
Compare
Choose a tag to compare
@github-actions github-actions released this 23 Sep 13:20
master-39ed572
39ed572
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode. 
Various improvements (#131)

* Implement model head offloading

* Guess the tokenizer from n_vocab

* Make PyTorch optional for inference

* Add function to offload layers

* Add rwkv_eval_sequence_in_chunks
Assets 7