smart_open
File streamer
A library that efficiently streams large files from/to various storage systems without requiring boilerplate code.
Utils for streaming large files (S3, HDFS, gzip, bz2...)
3k stars
47 watching
383 forks
Language: Python
last commit: 25 days ago
Linked from 2 awesome lists
botobz2filegzip-streamhacktoberfesthdfspythons3streamingstreaming-datawebhdfs
igorbarinov/awesome-data-engineering
monksy/awesome-data-engineeringRelated projects:
| Repository | Description | Stars |
|---|---|---|
 powerline/powerline | A plugin and framework for creating customizable, extensible statuslines and prompts for various applications | 14,395 |
 googleapis/google-api-python-client | A Python client library for Google's discovery based APIs. | 7,779 |
 python-mode/python-mode | A plugin that brings Python development tools to Vim, providing an IDE-like experience without losing the flexibility of Vim. | 5,448 |
 ipython/ipython | A command shell and interactive computing framework that provides rich media, shell syntax, tab completion, and history for multiple programming languages. | 16,311 |
 joestump/python-oauth2 | An abstract interface to creating OAuth clients and servers. | 2,990 |
 pycqa/modernize | Transforms Python 2 source code into compatible Python 3 and 2.6+ code | 355 |
 pysimplegui/pysimplegui | A Python GUI library that simplifies the development of desktop applications with a simple and intuitive interface. | 13,441 |
 miguelgrinberg/python-socketio | A Python implementation of the Socket.IO real-time communication protocol for building scalable web applications | 4,008 |
 openai/mujoco-py | A Python binding for the MuJoCo physics engine | 2,874 |
 azure/azure-sdk-for-python | A collection of libraries providing access to Azure services via the Python programming language. | 4,626 |
 open-mmlab/mmaction2 | A comprehensive video understanding toolbox and benchmark with modular design, supporting various tasks such as action recognition, localization, and retrieval. | 4,296 |
 minimaxir/gpt-2-simple | A tool for retraining and fine-tuning the OpenAI GPT-2 text generation model on new datasets. | 3,398 |
 pyenv/pyenv | Software that manages multiple versions of the Python programming language | 39,428 |
 pyston/pyston_v1 | A faster implementation of the Python programming language aimed at improving execution speed and compatibility. | 4,886 |
 opencv/opencv-python | Automated CI toolchain to produce precompiled packages for OpenCV library | 4,553 |