fugue

Distributed executor

A unified interface for distributed computing, allowing users to execute Python, Pandas, and SQL code on Spark, Dask, and Ray with minimal rewrites.

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

GitHub

2k stars
25 watching
94 forks
Language: Python
last commit: 2 months ago
Linked from 1 awesome list

daskdata-practitionersdistributeddistributed-computingdistributed-systemsmachine-learningpandassparksql

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
futurize/parallel-future A library that allows futures to be executed in parallel, contrasting with a sequential approach. 7
multiparty/conclave Allows users to define data analysis workflows in familiar languages and execute them on multiple backends for secure multi-party computation 98
nethermindeth/cairo-vm-go An implementation of a virtual machine for executing Cairo bytecode written in Go. 82
weihanli/dotnet-exec A tool for executing C# code without a project file, allowing custom entry points. 49
mobdk/core A tool that bypasses Windows Defender to execute any binary converted to shellcode using system calls. 43
itcathyh/conexec A toolkit to execute functions concurrently while specifying timeouts and efficient memory usage 16
davidstyers/golocity A command-line tool to deploy and manage Dockerized projects on the Golem Network 7
n00py/hwacha A tool to execute payloads on Unix-like systems by exploiting common weaknesses in password authentication mechanisms. 105
fox-it/dissect.executable A module implementing parsers for various executable file formats. 0
anthemtotheego/inlineexecute-assembly A proof of concept tool for executing .NET assemblies in the same process as a beacon implant, allowing for in-process execution and customization. 603
omnilib/aiomultiprocess A library that enables efficient concurrent execution of asynchronous tasks using both async and multiprocessing capabilities. 1,776
indigo-dc/udocker A tool to execute simple Docker containers in user space without root privileges 1,371
expensify/bedrock A highly available, distributed database that can automatically switch between multiple data centers and replicate data over wide area networks. 1,119
yahoo/vssh A Go library for executing commands over SSH at scale 962
marvinjanssen/executor-dao A modular DAO written in Clarity for the Stacks blockchain, allowing for flexible and powerful execution of proposals with optional extensions adding specific features. 44