huniq

Dupfinder

Filtering out duplicates from data

Filter out duplicates on the command line. Replacement for sort | uniq optimized for speed (10x faster) when sorting is not needed.

GitHub

243 stars
5 watching
12 forks
Language: Rust
last commit: over 2 years ago
Linked from 1 awesome list

clirusttools

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
whitfin/runiqEfficient filtering of duplicate lines from input data210
mhasbini/dupruleRemoves duplicate hashcat rule modifications by identifying unique rule changes and selecting the one with the fewest function calls.41
nil0x42/duplicutTools to remove duplicates from massive wordlists used in password cracking885
duailibe/cuidGenerates unique, sequential IDs with optimal performance for horizontal scaling and lookup55
replicatedhq/unforkTool to analyze and restore Helm charts in a Kubernetes cluster146
patois/xrayTool for filtering and highlighting decompiler output based on regular expressions125
hagrid29/duplicatedumpTools to dump LSASS memory without detection using custom LSA plugin and duplicated handle199
replicatedhq/outdatedA tool to identify outdated images running in a Kubernetes cluster426
rentruewang/koilaA lightweight wrapper around PyTorch to prevent CUDA out-of-memory errors and optimize model execution1,823
nvzqz/divanA tool for measuring performance in Rust applications988
kunalsin9h/livejqAn alternative to jq with continuous parsing support and filtering capabilities for handling invalid JSON without crashing.15
darakian/ddhA tool to compare duplicate files across directories by hashing and reporting findings.454
kornelski/dupe-krillA tool that identifies and replaces duplicate files with hardlinks to reduce storage space.187
hakancelikdev/unimportTool for detecting and removing unused import statements in code239
ayrat555/fangBackground task processing and queueing system for Rust applications.627