FlutterTrends.dev
⌘K
Sponsored by- The #1 Flutter-powered AI app builder
Home/Top/Ai Ml/tiktoken

tiktoken

Published by 🇭🇷marinvitlov.com · v1.0.3 · released 3 years ago · MIT License

First published 3 years ago.

Tiktoken is a BPE tokeniser for use with OpenAI's models. It exposes APIs used for processing text using tokens.

View on pub.dev View source
#112 in Ai Ml #5781 overall no release in 3 years androidioswindowslinuxmacosweb
Downloads / day
41
as of 2026-08-23
GitHub stars
26
★ refreshed weekly
Likes
22
on pub.dev
Pub points
160 / 160
perfect score
2026-07-24 2026-08-23

Repository health

Last commit
3 years ago
Commit activity
Open issues
5
Open PRs
1
Contributors
1
CI
None detected
License (repo)

Last refreshed 13 days ago.

License explained · NOASSERTION

NOASSERTION

No plain-English summary available for this SPDX identifier.

Read the canonical text on SPDX to understand what this license permits and requires.

Full text on spdx.org.

Commit activity, past 52 weeks

tiktoken

0 commits in the past year
Stable
1 1 0 52w ago36w ago18w agothis week
Weekly average
0.0 commits
Busiest week
0 commits, this week
Active weeks
0 of 52 (0%)
Longest quiet stretch
52 weeks with no commits

Weekly commits to the default branch on GitHub. Source: GET /stats/participation. Refreshed weekly. Excludes commits to other branches.

How tiktoken compares in Ai Ml

Top of the Ai Ml leaderboard, with tiktoken highlighted.

Rank Package Downloads / day Stars Likes
#1
google_mlkit_commons
flutter-ml.dev
14.9K ★ 1.3K 37
#2
google_mlkit_text_recognition
flutter-ml.dev
8.6K ★ 1.3K 406
#3
mcp_dart
🇨🇦 leehack.com
7.7K ★ 113 75
#4
marionette_flutter
🇨🇴 leancode.co
5.2K ★ 375 56
#112
tiktoken
marinvitlov.com
41 ★ 26 22