smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
3k stars
47 watching
383 forks
Language: Python
last commit: 19 days ago
Linked from 2 awesome lists
botobz2filegzip-streamhacktoberfesthdfspythons3streamingstreaming-datawebhdfs
igorbarinov/awesome-data-engineering
monksy/awesome-data-engineering