Skip to content

Commit

Permalink
Fix typo in rwkv.h docs for n_vocab (#96)
Browse files Browse the repository at this point in the history
World models actually have 65536, not 65535, oops
  • Loading branch information
LoganDark committed Jun 13, 2023
1 parent 7199f5b commit c64009e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion rwkv.h
Original file line number Diff line number Diff line change
Expand Up @@ -123,7 +123,7 @@ extern "C" {
RWKV_API bool rwkv_eval_sequence(const struct rwkv_context * ctx, const uint32_t * tokens, size_t sequence_len, const float * state_in, float * state_out, float * logits_out);

// Returns the number of tokens in the given model's vocabulary.
// Useful for telling legacy RWKV models (n_vocab = 50277) apart from modern World models (n_vocab = 65535).
// Useful for telling legacy RWKV models (n_vocab = 50277) apart from modern World models (n_vocab = 65536).
RWKV_API size_t rwkv_get_n_vocab(const struct rwkv_context * ctx);

// Returns the number of elements in the given model's embed weights.
Expand Down

0 comments on commit c64009e

Please sign in to comment.