The
Flutter-powered AI app builder tokenizer
Published by 🇵🇱lesnitsky.dev · v1.0.0 · released 3 years ago · MIT License
First published 6 years ago.
Converts a stream of strings into a stream of tokens
#3139 in Utilities #23991 overall no release in 3 years androidioswindowslinuxmacosweb
Downloads / day
1
as of 2026-07-06
GitHub stars
5
★ refreshed weekly
Likes
6
on pub.dev
Pub points
140 / 160
2026-06-06 2026-07-06
How tokenizer compares in Utilities
Top of the Utilities leaderboard, with tokenizer highlighted.
| Rank | Package | Downloads / day | Stars | Likes |
|---|---|---|---|---|
| #1 | 🇺🇸 google.dev | 356.4K | ★ 886 | 780 |
| #2 | 🇺🇸 loki3d.com | 342.9K | ★ 464 | 896 |
| #3 | 🇺🇸 dart.dev | 340.9K | ★ 11.2K | 475 |
| #4 | 🇺🇸 dart.dev | 334.4K | ★ 69 | 635 |
| #3139 | lesnitsky.dev | 1 | ★ 5 | 6 |