#4,924 of 5,656 by stars
huggingface/tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- Stars
- 11,185
- Forks
- 1,229
- Created
- 6y ago
- Last push
- today
Momentum
- Per day
- +2
- Per 7 days
- +18
- Per 30 days
- +136
- Rank, 7 days
- -12
Stars over time
View as table
| Date | Stars |
|---|---|
| Sep 17, 2026 | 11,040 |
| Oct 5, 2026 | 11,152 |
| Oct 12, 2026 | 11,167 |
| Oct 19, 2026 | 11,185 |
Understand this repo
Open it in a tool that explains, diagrams or digests the code.
- Explain A plain-language walkthrough of what the project is and does
- Diagram An interactive architecture diagram of the codebase
- Ingest for AI The whole repository as one text digest to paste into an AI assistant
- Reverse prompt A prompt describing how to rebuild the project
These open independent third-party sites, which may be slow or unavailable for very large repositories.
Similar repositories
Ranked by how many distinctive topics they share with this one.
- 754
google-research/bertArchivedTensorFlow code and pre-trained models for BERT
- 3413
Natural Language Processing Tutorial for Deep Learning Researchers
- 2778
📺 Discover the latest machine learning / AI courses on YouTube.
- 4597
allenai/allennlpArchivedAn open-source NLP research library, built on PyTorch.
- 4649
This repository contains demos I made with the Transformers library by HuggingFace.
- 118
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step