💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
-
Updated
Jul 4, 2025 - Rust
#
Natural language processing
Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.
Here are 184 public repositories matching this topic...
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
nlp rust machine-learning translation deep-learning sentiment-analysis transformer rust-lang question-answering bart gpt ner bert language-generation electra roberta gpt-2
-
Updated
Jun 10, 2025 - Rust
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
nlp rust pdf machine-learning natural-language-processing ocr etl tika extraction docx data-pipelines pdf-parser unstructured unstructured-data rag etl-pipelines llm
-
Updated
Dec 21, 2024 - Rust
Natural language detection library for Rust. Try demo online: https://whatlang.org/
nlp language rust classifier algorithm ai text-classification text-analysis rustlang detect-language language-recognition text-classifier whatlang
-
Updated
Mar 12, 2025 - Rust
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
nlp rust natural-language-processing language-detection rust-library nlp-machine-learning language-recognition language-processing rust-crate language-identification language-classification
-
Updated
Jun 18, 2025 - Rust
The Jieba Chinese Word Segmentation Implemented in Rust
-
Updated
May 28, 2025 - Rust
A fast, low-resource Natural Language Processing and Text Correction library written in Rust.
nlp rust machine-learning natural-language-processing spellcheck grammar style-checker proofreading grammatical-error-correction
-
Updated
May 23, 2023 - Rust
🎤 vibrato: Viterbi-based accelerated tokenizer
-
Updated
May 14, 2025 - Rust
Checks all your documentation for spelling and grammar mistakes with hunspell and a nlprule based checker for grammar
nlp grammar cargo spelling languagetool hacktoberfest hunspell spellchecker cargo-plugin grammarchecker cargo-spellcheck grammar-mistakes
-
Updated
Apr 10, 2025 - Rust
🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
-
Updated
Jun 13, 2025 - Rust
🕷️ The pipeline for the OSCAR corpus
-
Updated
Dec 18, 2023 - Rust
Simple NLP in Rust with Python bindings
-
Updated
Jul 6, 2023 - Rust
Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
nlp rust ai chatbot openai rust-library builder-pattern rust-crate llm prompt-engineering anthropic ollama
-
Updated
May 20, 2025 - Rust
Official Rust Implementation of Model2Vec
-
Updated
Jul 3, 2025 - Rust
Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
-
Updated
Sep 17, 2024 - Rust
Created by Alan Turing
- Followers
- 25.8k followers
- Website
- github.com/topics/nlp
- Wikipedia
- Wikipedia