fugue

Distributed executor

A unified interface for distributed computing, allowing users to execute Python, Pandas, and SQL code on Spark, Dask, and Ray with minimal rewrites.

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

GitHub

2k stars
25 watching
94 forks
Language: Python
last commit: almost 2 years ago
Linked from 1 awesome list

daskdata-practitionersdistributeddistributed-computingdistributed-systemsmachine-learningpandassparksql

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
futurize/parallel-futureA library that allows futures to be executed in parallel, contrasting with a sequential approach.7
multiparty/conclaveAllows users to define data analysis workflows in familiar languages and execute them on multiple backends for secure multi-party computation99
nethermindeth/cairo-vm-goAn implementation of a virtual machine for executing Cairo bytecode written in Go.82
weihanli/dotnet-execA tool for executing C# code without a project file, allowing custom entry points.51
mobdk/coreA tool that bypasses Windows Defender to execute any binary converted to shellcode using system calls.43
itcathyh/conexecA toolkit to execute functions concurrently while specifying timeouts and efficient memory usage16
davidstyers/golocityA command-line tool to deploy and manage Dockerized projects on the Golem Network7
n00py/hwachaA tool to execute payloads on Unix-like systems by exploiting common weaknesses in password authentication mechanisms.105
fox-it/dissect.executableA Python module providing parsers for various executable formats like PE, ELF, and Macho-O.0
anthemtotheego/inlineexecute-assemblyA proof of concept tool for executing .NET assemblies in the same process as a beacon implant, allowing for in-process execution and customization.617
omnilib/aiomultiprocessA library that enables efficient concurrent execution of asynchronous tasks using both async and multiprocessing capabilities.1,787
indigo-dc/udockerA tool to execute simple Docker containers in user space without root privileges1,387
expensify/bedrockA highly available, distributed database that can automatically switch between multiple data centers and replicate data over wide area networks.1,124
yahoo/vsshA Go library for executing commands over SSH at scale964
marvinjanssen/executor-daoA modular DAO written in Clarity for the Stacks blockchain, allowing for flexible and powerful execution of proposals with optional extensions adding specific features.44