FlutterTrends.dev
⌘K
Sponsored by- The #1 Flutter-powered AI app builder
Home/Top/Ai Ml/tiktoken_tokenizer_gpt4o_o1

tiktoken_tokenizer_gpt4o_o1

Published by 🇺🇸glasberg.dev · v1.2.1 · released 1 year ago · BSD-2-CLAUSE License

First published 1 year ago.

OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.

View on pub.dev View source
#274 in Ai Ml #10109 overall no release in 1 year androidioswindowslinuxmacosweb
Downloads / day
15
as of 2026-10-19
GitHub stars
5
★ refreshed weekly
Likes
3
on pub.dev
Pub points
140 / 160
2026-09-19 2026-10-19

Repository health

Last commit
1 year ago
Commit activity
Open issues
0
Open PRs
0
Contributors
1
CI
None detected
License (repo)

Last refreshed 21 days ago.

License explained · BSD-2-Clause

BSD 2-Clause "Simplified" License

Use freely, even commercially. Just keep the copyright notice. Effectively identical to MIT.

A permissive license that comes in two variants, the BSD 2-Clause and BSD 3-Clause. Both have very minute differences to the MIT license.

You can

  • Commercial use
  • Distribution
  • Modification
  • Private use

You must

  • Include the license and copyright notice

The license does not

  • No liability
  • No warranty

Plain-English summary, not legal advice. Full text on SPDX or choosealicense.com. Summaries adapted from choosealicense.com (a GitHub project, MIT-licensed).

Commit activity, past 52 weeks

tiktoken_tokenizer_gpt4o_o1

0 commits in the past year
Stable
1 1 0 52w ago36w ago18w agothis week
Weekly average
0.0 commits
Busiest week
0 commits, this week
Active weeks
0 of 52 (0%)
Longest quiet stretch
52 weeks with no commits

Weekly commits to the default branch on GitHub. Source: GET /stats/participation. Refreshed weekly. Excludes commits to other branches.

How tiktoken_tokenizer_gpt4o_o1 compares in Ai Ml

Top of the Ai Ml leaderboard, with tiktoken_tokenizer_gpt4o_o1 highlighted.

Rank Package Downloads / day Stars Likes
#1
google_mlkit_commons
flutter-ml.dev
19.1K ★ 1.3K 38
#2
google_mlkit_text_recognition
flutter-ml.dev
11.1K ★ 1.3K 413
#3
mcp_dart
🇨🇦 leehack.com
7.2K ★ 114 77
#4
marionette_flutter
🇨🇴 leancode.co
6.8K ★ 464 69
#274
tiktoken_tokenizer_gpt4o_o1
glasberg.dev
15 ★ 5 3