ruby-ngram
by tkellen
Break words and phrases into ngrams.
AI summary
Text segmenter
Breaks text into contiguous sequences of words or phrases
- stars
- 12
- forks
- 2
- watching
- 4
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Text splitter
A tool for splitting text into sequences of words
Sentence tokenizer
A Ruby port of the NLTK algorithm to detect sentence boundaries in unstructured text
Text tokenizer
A Ruby port of a Japanese text tokenization algorithm
Text classifier
Efficient text classification and representation learning library for Ruby
N-Gram generator
Generates sequences of characters from a given text, useful for data analysis and modeling
Ruby block selector
A Vim plugin for selecting Ruby blocks
ngram generator
A flexible ngrams library in Ruby allowing users to model and generate text
Text data loader
A Ruby library providing data loaders and abstractions for text and NLP tasks
Tokenizer
A Ruby library that tokenizes input and provides various statistical measures about the tokens
Sentence segmenter
A rule-based sentence boundary detection gem that works across many languages
Ruby Profiler
A line profiler for Ruby programming language
Text generator
A Ruby library providing an interface to Large Language Model (LLM) providers for text generation and embedding
ANN library
A high-performance approximate nearest neighbors search library for Ruby
Text reducer
A Ruby library that provides a lemmatizer for text in English.
Sentence splitter
A Ruby library that uses a simple rule-based approach to segment sentences into individual words or phrases.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions ruby-ngram.
