huniq
by koraa
Filter out duplicates on the command line. Replacement for sort | uniq optimized for speed (10x faster) when sorting is not needed.
AI summary
Dupfinder
Filtering out duplicates from data
- stars
- 243
- forks
- 12
- watching
- 5
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
filterer
Efficient filtering of duplicate lines from input data
Rule cleaner
Removes duplicate hashcat rule modifications by identifying unique rule changes and selecting the one with the fewest function calls.
Wordlist deduper
Tools to remove duplicates from massive wordlists used in password cracking
ID generator
Generates unique, sequential IDs with optimal performance for horizontal scaling and lookup
Chart fixer
Tool to analyze and restore Helm charts in a Kubernetes cluster
patois/xray125
Filterer
Tool for filtering and highlighting decompiler output based on regular expressions
LSASS dumper
Tools to dump LSASS memory without detection using custom LSA plugin and duplicated handle
Image scanner
A tool to identify outdated images running in a Kubernetes cluster
Memory optimizer for deep learning models
A lightweight wrapper around PyTorch to prevent CUDA out-of-memory errors and optimize model execution
nvzqz/divan988
Benchmarking tool
A tool for measuring performance in Rust applications
JSON parser
An alternative to jq with continuous parsing support and filtering capabilities for handling invalid JSON without crashing.
darakian/ddh454
File comparer
A tool to compare duplicate files across directories by hashing and reporting findings.
File deduplicator
A tool that identifies and replaces duplicate files with hardlinks to reduce storage space.
Import cleaner
Tool for detecting and removing unused import statements in code
Task processor
Background task processing and queueing system for Rust applications.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions huniq.
