dart_sentencepiece_tokenizer
Published by brodykim.work · v1.3.2 · MIT License
A lightweight, pure Dart implementation of SentencePiece tokenizer. Supports BPE (Gemma) and Unigram (Llama) algorithms.
#2664 overall androidioswindowslinuxmacos
Downloads / 30d
6,903
as of 2026-05-06
GitHub stars
0
★ refreshed weekly
Likes
4
on pub.dev
Pub points
160 / 160
perfect score
2-day trend
Monthly downloads, sampled daily at 03:00 UTC 2026-05-05 2026-05-06
Top packages
Other libraries in the same category.