aws-sdk-pandas

AWS data integration library

A Python library providing an interface to various AWS data services for efficient data integration and analysis

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

GitHub

4k stars
60 watching
701 forks
Language: Python
last commit: 6 days ago
Linked from 5 awesome lists

amazon-athenaamazon-sagemaker-notebookapache-arrowapache-parquetathenaawsaws-glueaws-lambdadata-engineeringdata-scienceemretlglue-cataloglambdamodinmysqlpandaspythonrayredshift

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
alecblance/s3bucketlist Lists and searches Amazon S3 buckets found in network requests while browsing the web. 78
datazoompuc/datazoom.amazonia A package providing access to various datasets on the Brazilian Amazon, including environmental, social, and economic data. 53
eth0izzle/bucket-stream Tools to identify publicly accessible S3 buckets by monitoring certificate transparency logs. 1,753
jordanpotti/awsbucketdump Automates the process of discovering and analyzing interesting files in Amazon S3 buckets 1,365
mumrah/s3-multipart Tools for parallel file transfer to and from Amazon S3 163
s3fs-fuse/s3fs-fuse A FUSE-based file system for interacting with Amazon S3 storage 8,675
s3tools/s3cmd A command line tool and client for managing data in Amazon S3 and other cloud storage services 4,594
glen-mac/gogetbucket Automated tool to discover and analyze AWS S3 buckets owned by a specific domain. 110
sa7mon/s3scanner Tools for identifying and scanning misconfigured S3 buckets across multiple cloud storage providers. 2,572
fishermansenemy/bucket_finder Automates the process of scanning Amazon S3 buckets to find files 95
adamsb6/s3_file A Ruby module for fetching files from Amazon S3 with flexible download options and error handling 64
marcel/aws-s3 A Ruby implementation of Amazon's S3 REST API 775
m3db/m3 A distributed data storage and query system with Prometheus integration and Graphite compatibility. 4,767
e-dard/flask-s3 A Python package that enables seamless integration of static assets with Flask applications using Amazon S3 198
owocki/s3_disk_util Tool to display disk usage of AWS S3 buckets 169