Picture tokens

[arthurwolf]

Hello.

The new -vision model lets you pass images (which end up as tokens).
To properly calculate token use for my stuff, I'd need to be able to pass my full conversation/payload, which includes images.
Does this tokenizer support that (reading the docs I don't see signs it does).
Would you have recommendations of how to implement that on my side?
And if I do implement it would that be a welcome PR?

Cheers.