Zero-dependency implementation of BitNet neural network training and BPE tokenization in C
-
Updated
Aug 3, 2024 - C
#
bpe
Here are 4 public repositories matching this topic...
🐍This is a fast, lightweight, and clean CPython extension for the Byte Pair Encoding (BPE) algorithm, which is commonly used in LLM tokenization and NLP tasks.
-
Updated
Apr 20, 2025 - C
Information Retreival Course Repository, 7th Semester, IITD, 2023-24
word2vec language-modeling inverted-index posting-list ir query-expansion variable-byte-encoding pseudo-relevance-feedback borda-count bpe rrf condorcet-voting bayes-fuse
-
Updated
Dec 11, 2023 - C
Improve this page
Add a description, image, and links to the bpe topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bpe topic, visit your repo's landing page and select "manage topics."