MalPipe

Data processor

An ingestion and processing framework for malware and indicator data from various feeds.

Malware/IOC ingestion and processing engine

GitHub

103 stars
11 watching
24 forks
Language: Python
last commit: about 6 years ago
Linked from 2 awesome lists


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
olirice/flupy A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory 193
nazar256/parapipe A non-blocking buffered pipeline library that allows concurrent processing of data while maintaining output order without locks or mutexes. 31
nysol/mcmd A set of commands for high-speed processing of large-scale CSV data 33
silascutler/virustotaltools Tools for interacting with Virus Total's Yara rule management system. 35
sipsorcery-org/sipsorcerymedia.abstractions Provides interfaces and abstractions for media processing in real-time communications 5
danielstjules/pjs A tool for filtering, mapping, and reducing data in JavaScript from the command line. 419
giacbrd/smartpipeline A framework for designing and executing concurrent data pipelines with a focus on simplicity and efficiency 23
julienpalard/pipe A Python library providing a simple and flexible way to process sequences of data using infix notation. 1,954
snoyberg/conduit A framework for handling and transforming streaming data in a consistent and efficient way 903
johnsonc/lambdo A workflow engine for unifying feature engineering and machine learning operations in data analysis pipelines 1
ypares/porcupine A tool that enables data manipulation and analysis pipelines to be flexible, reusable, and reproducible in different environments 89
mitrecnd/malchive A collection of reusable scripts and tools for analyzing malicious software 75
cert-polska/karton A framework for building flexible and lightweight malware analysis pipelines 393
raine/ramda-cli A tool for composing functions into data-processing pipelines to produce desired output. 573
msamogh/nonechucks Library that provides dynamic data cleaning and filtering capabilities for PyTorch datasets and samplers 377