tiktoken
/All repositories
Overview
HEALTH SCORE
Healthy
73out of 100
Solid maintainer coverage and development cadence. Security posture keeps the score from reaching Excellent.
LIFECYCLE
Active
Consistent commits, responsive maintainers, regular releases, and healthy issue triage.
Health breakdown
Healthy(73/100)
Maintainer availability, known risks and supply chain posture, and whether the project is actively developed or appropriately stable.
Maintainer responsiveness
Median response time is 10 days.
Bus factor
14 active maintainers currently have merge rights.
Organization Diversity
Contributors span 638 organizations.
Project Achievements
Leaderboards
About
A fast BPE tokenizer for use with OpenAI's models, implemented in Rust with Python bindings. It provides efficient tokenization functionality used by GPT models to convert text into tokens.
First commit
Software value
$81K
License(s)
MIT
Links
Data sources
Git
GitHub