langchain_tiktoken
Published by dragonx.cloud · v1.0.1 · MIT License
A BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.
#4440 overall androidioswindowslinuxmacosweb
Downloads / 30d
1,795
as of 2026-05-06
GitHub stars
1
★ refreshed weekly
Likes
3
on pub.dev
Pub points
140 / 160
2-day trend
Monthly downloads, sampled daily at 03:00 UTC 2026-05-05 2026-05-06
Top packages
Other libraries in the same category.