FlutterTrends.dev
⌘K
Sponsored by- The #1 Flutter-powered AI app builder
Home/Top/Ai Ml/dart_sentencepiece_tokenizer

dart_sentencepiece_tokenizer

Published by 🇰🇷brodykim.work · v1.4.1 · released 1 month ago · MIT License

First published 9 months ago.

A lightweight pure Dart SentencePiece tokenizer supporting BPE (Gemma), Unigram (Llama), and Hugging Face tokenizer.json pipelines.

View on pub.dev View source
#20 in Ai Ml #1492 overall androidioswindowslinuxmacos
Downloads / day
1,433
as of 2026-10-19
GitHub stars
0
★ refreshed weekly
Likes
7
on pub.dev
Pub points
160 / 160
perfect score
2026-09-19 2026-10-19

Repository health

Last commit
1 month ago
Commit activity
Open issues
0
Open PRs
0
Contributors
2 (top contributor 95%)
CI
GitHub Actions
License (repo)

Last refreshed 4 days ago.

License explained · MIT

MIT License

Use freely, even commercially. Just keep the copyright notice.

A short and simple permissive license with conditions only requiring preservation of copyright and license notices. Licensed works, modifications, and larger works may be distributed under different terms and without source code.

You can

  • Commercial use
  • Distribution
  • Modification
  • Private use

You must

  • Include the license and copyright notice

The license does not

  • No liability
  • No warranty

Plain-English summary, not legal advice. Full text on SPDX or choosealicense.com. Summaries adapted from choosealicense.com (a GitHub project, MIT-licensed).

Commit activity, past 52 weeks

dart_sentencepiece_tokenizer

21 commits in the past year
Accelerating +25% vs 9 months ago
5 3 0 52w ago36w ago18w agothis week
Weekly average
0.4 commits
Busiest week
5 commits, 27 weeks ago
Active weeks
8 of 52 (15%)
Longest quiet stretch
19 weeks with no commits

Weekly commits to the default branch on GitHub. Source: GET /stats/participation. Refreshed weekly. Excludes commits to other branches.

How dart_sentencepiece_tokenizer compares in Ai Ml

Top of the Ai Ml leaderboard, with dart_sentencepiece_tokenizer highlighted.

Rank Package Downloads / day Stars Likes
#1
google_mlkit_commons
flutter-ml.dev
19.1K ★ 1.3K 38
#2
google_mlkit_text_recognition
flutter-ml.dev
11.1K ★ 1.3K 413
#3
mcp_dart
🇨🇦 leehack.com
7.2K ★ 114 77
#4
marionette_flutter
🇨🇴 leancode.co
6.8K ★ 464 69
#20
dart_sentencepiece_tokenizer
brodykim.work
1.4K ★ 0 7