Awesome Lists

awesome-python

by vinta

awesome listPythonpushed about 2 years ago

An opinionated list of awesome Python frameworks, libraries, software and resources.

AI summary

Python collections

An curated list of Python frameworks, libraries, and resources for software development.

stars
227.8K
forks
25K
watching
6.1K
awesome lists
32
entries
595
View on GitHubawesome-python.com

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/vinta/awesome-python/links.svg)](https://awesome.facts.dev/awesome/vinta/awesome-python)
HTML
<a href="https://awesome.facts.dev/awesome/vinta/awesome-python"><img src="https://awesome.facts.dev/shield/vinta/awesome-python/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/vinta/awesome-python/links.svg

What's in the list

595 links in 158 sections, with live GitHub stats.activeno commit in 2y

Admin Panels

  • ajenti

    The admin panel your servers deserve

  • django-grappelli

    A jazzy skin for the Django Admin-Interface

  • flask-admin

    Simple and extensible administrative interface framework for Flask

  • flower

    Real-time monitor and web admin for Celery

  • jet-bridge

    Admin panel framework for any application with nice UI (ex Jet Django)

  • wooey

    A Django app which creates automatic web UIs for Python scripts

  • streamlit

    A framework which lets you build dashboards, generate reports, or create chat apps in minutes

Algorithms and Design Patterns / Algorithms

  • algorithms

    Minimal examples of data structures and algorithms

  • python-ds

    A collection of data structure and algorithms for coding interviews

  • sortedcontainers

    Fast and pure-Python implementation of sorted collections

  • thealgorithms

    All Algorithms implemented in Python

Algorithms and Design Patterns / Design Patterns

  • pypattyrn

    A simple yet effective library for implementing common design patterns

  • python-patterns

    A collection of design patterns in Python

  • transitions

    A lightweight, object-oriented finite state machine implementation

ASGI Servers

  • daphne

    A HTTP, HTTP2 and WebSocket protocol server for ASGI and ASGI-HTTP

  • uvicorn

    A lightning-fast ASGI server implementation, using uvloop and httptools

  • hypercorn

    An ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn

Asynchronous Programming

  • asyncio

    (Python standard library) Asynchronous I/O, event loop, coroutines and tasks

Asynchronous Programming / asyncio

Asynchronous Programming

  • concurrent.futures

    (Python standard library) A high-level interface for asynchronously executing callables

  • multiprocessing

    (Python standard library) Process-based parallelism

  • trio

    A friendly library for async concurrency and I/O

  • twisted

    An event-driven networking engine

  • uvloop

    Ultra fast asyncio event loop

  • eventlet

    Asynchronous framework with WSGI support

  • gevent

    A coroutine-based Python networking library that uses

Audio / Audio

  • audioread

    Cross-library (GStreamer + Core Audio + MAD + FFmpeg) audio decoding

  • audioFlux

    A library for audio and music analysis, feature extraction

  • dejavu

    Audio fingerprinting and recognition

  • kapre

    Keras Audio Preprocessors

  • librosa

    Python library for audio and music analysis

  • matchering

    A library for automated reference audio mastering

  • mingus

    An advanced music theory and notation package with MIDI file and playback support

  • pyaudioanalysis

    Audio feature extraction, classification, segmentation and applications

  • pydub

    Manipulate audio with a simple and easy high level interface

  • timeside

    Open web audio processing framework

Audio / Metadata

  • beets

    A music library manager and tagger

  • eyed3

    A tool for working with audio files, specifically MP3 files containing ID3 metadata

  • mutagen

    A Python module to handle audio metadata

  • tinytag

    A library for reading music meta data of MP3, OGG, FLAC and Wave files

Authentication / OAuth

  • authlib

    JavaScript Object Signing and Encryption draft implementation

  • django-allauth

    Authentication app for Django that "just works."

  • django-oauth-toolkit

    OAuth 2 goodies for Django

  • oauthlib

    A generic and thorough implementation of the OAuth request-signing logic

Authentication / JWT

  • pyjwt

    JSON Web Token implementation in Python

  • python-jose

    A JOSE implementation in Python

Build Tools

  • bitbake

    A make-like build tool for embedded Linux

  • buildout

    A build system for creating, assembling and deploying applications from multiple parts

  • platformio

    A console tool to build code with different development platforms

  • pybuilder

    A continuous build tool written in pure Python

  • scons

    A software construction tool

Built-in Classes Enhancement

  • attrs

    Replacement for , , , etc. boilerplate in class definitions

  • bidict

    Efficient, Pythonic bidirectional map data structures and related functionality

  • box

    Python dictionaries with advanced dot notation access

  • dataclasses

    (Python standard library) Data classes

  • dotteddict

    A library that provides a method of accessing lists and dicts with a dotted path notation

CMS

  • feincms

    One of the most advanced Content Management Systems built on Django

  • indico

    A feature-rich event management system, made @

  • wagtail

    A Django content management system

Caching

  • beaker

    A WSGI middleware for sessions and caching

  • django-cache-machine

    Automatic caching and invalidation for Django models

  • django-cacheops

    A slick ORM cache with automatic granular event-driven invalidation

  • dogpile.cache

    dogpile.cache is a next generation replacement for Beaker made by the same authors

  • hermescache

    Python caching library with tag-based invalidation and dogpile effect prevention

  • pylibmc

    A Python wrapper around the interface

  • python-diskcache

    SQLite and file backed cache backend with faster lookups than memcached and redis

ChatOps Tools

  • errbot

    The easiest and most popular chatbot to implement ChatOps

Code Analysis / Code Analysis

  • code2flow

    Turn your Python and JavaScript code into DOT flowcharts

  • prospector

    A tool to analyse Python code

  • vulture

    A tool for finding and analysing dead Python code

Code Analysis / Code Linters

  • flake8

    A wrapper around , and McCabe

Code Analysis / Code Linters / flake8

Code Analysis / Code Linters

  • pylint

    A fully customizable source code analyzer

Code Analysis / Code Formatters

  • black

    The uncompromising Python code formatter

  • isort

    A Python utility / library to sort imports

  • yapf

    Yet another Python code formatter from Google

Code Analysis

Code Analysis / awesome-python-typing

  • mypy

    Check variable types during compile time

  • pyre-check

    Performant type checking

  • typeshed

    Collection of library stubs for Python, with static types

Code Analysis / Static Type Annotations Generators

  • monkeytype

    A system for Python that generates static type annotations by collecting runtime types

  • pytype

    Pytype checks and infers types for Python code - without requiring type annotations

Command-line Interface Development / Command-line Application Development

  • cement

    CLI Application Framework for Python

  • click

    A package for creating beautiful command line interfaces in a composable way

  • cliff

    A framework for creating command-line programs with multi-level commands

  • python-fire

    A library for creating command line interfaces from absolutely any Python object

  • python-prompt-toolkit

    A library for building powerful interactive command lines

Command-line Interface Development / Terminal Rendering

  • alive-progress

    A new kind of Progress Bar, with real-time throughput, eta and very cool animations

  • asciimatics

    A package to create full-screen text UIs (from interactive forms to ASCII animations)

  • bashplotlib

    Making basic plots in the terminal

  • colorama

    Cross-platform colored terminal text

  • rich

    Python library for rich text and beautiful formatting in the terminal. Also provides a great log handler

  • tqdm

    Fast, extensible progress bar for loops and CLI

Command-line Tools / Productivity Tools

  • copier

    A library and command-line utility for rendering projects templates

  • cookiecutter

    A command-line utility that creates projects from cookiecutters (project templates)

  • doitlive

    A tool for live presentations in the terminal

  • howdoi

    Instant coding answers via the command line

  • invoke

    A tool for managing shell-oriented subprocesses and organizing executable Python code into CLI-invokable tasks

  • pathpicker

    Select files out of bash output

  • thefuck

    Correcting your previous console command

  • tmuxp

    A session manager

  • try

    A dead simple CLI to try out python packages - it's never been easier

Command-line Tools / CLI Enhancements

  • httpie

    A command line HTTP client, a user-friendly cURL replacement

  • iredis

    Redis CLI with autocompletion and syntax highlighting

  • litecli

    SQLite CLI with autocompletion and syntax highlighting

  • mycli

    MySQL CLI with autocompletion and syntax highlighting

  • pgcli

    PostgreSQL CLI with autocompletion and syntax highlighting

Computer Vision

  • easyocr

    Ready-to-use OCR with 40+ languages supported

  • kornia

    Open Source Differentiable Computer Vision Library for PyTorch

  • opencv

    Open Source Computer Vision Library

  • pytesseract

    A wrapper for

  • tesserocr

    Another simple, Pillow-friendly, wrapper around the API for OCR

Configuration Files

  • configparser

    (Python standard library) INI file parser

  • configobj

    INI file parser with validation

  • hydra

    Hydra is a framework for elegantly configuring complex applications

  • python-decouple

    Strict separation of settings from code

Cryptography

  • cryptography

    A package designed to expose cryptographic primitives and recipes to Python developers

  • paramiko

    The leading native Python SSHv2 protocol library

  • pynacl

    Python binding to the Networking and Cryptography (NaCl) library

Data Analysis

  • pandas

    A library providing high-performance, easy-to-use data structures and data analysis tools

  • aws-sdk-pandas

    Pandas on AWS

  • datasette

    An open source multi-tool for exploring and publishing data

  • optimus

    Agile Data Science Workflows made easy with PySpark

Data Validation

  • cerberus

    A lightweight and extensible data validation library

  • colander

    Validating and deserializing data obtained via XML, JSON, an HTML form post

  • jsonschema

    An implementation of for Python

  • schema

    A library for validating Python data structures

  • schematics

    Data Structure Validation

  • voluptuous

    A Python data validation library

  • pydantic

    Data validation using Python type hints

Data Visualization

  • altair

    Declarative statistical visualization library for Python

  • bokeh

    Interactive Web Plotting for Python

  • bqplot

    Interactive Plotting Library for the Jupyter Notebook

  • cartopy

    A cartographic python library with matplotlib support

  • diagrams

    Diagram as Code

  • matplotlib

    A Python 2D plotting library

  • plotnine

    A grammar of graphics for Python based on ggplot2

  • pygal

    A Python SVG Charts Creator

  • pygraphviz

    Python interface to

  • pyqtgraph

    Interactive and realtime 2D/3D/Image plotting and science/engineering widgets

  • seaborn

    Statistical data visualization using Matplotlib

  • vispy

    High-performance scientific visualization based on OpenGL

Database

  • pickleDB

    A simple and lightweight key-value store for Python

  • tinydb

    A tiny, document-oriented database

  • zodb

    A native object database for Python. A key-value and object graph database

Database Drivers

Database Drivers / awesome-mysql

  • mysqlclient

    MySQL connector with Python 3 support ( fork)

  • pymysql

    A pure Python MySQL driver compatible to mysql-python

Database Drivers

Database Drivers / awesome-postgres

  • psycopg

    The most popular PostgreSQL adapter for Python

Database Drivers

Database Drivers / awesome-sqlite

  • sqlite3

    (Python standard library) SQlite interface compliant with DB-API 2.0

  • sqlite-utils

    Python CLI utility and library for manipulating SQLite databases

Database Drivers / Other Relational Databases

  • pymssql

    A simple database interface to Microsoft SQL Server

  • clickhouse-driver

    Python driver with native interface for ClickHouse

Database Drivers / NoSQL Databases

  • cassandra-driver

    The Python Driver for Apache Cassandra

  • happybase

    A developer-friendly library for Apache HBase

  • kafka-python

    The Python client for Apache Kafka

  • pymongo

    The official Python client for MongoDB

  • motor

    The async Python driver for MongoDB

  • redis-py

    The Python client for Redis

Date and Time

  • arrow

    A Python library that offers a sensible and human-friendly approach to creating, manipulating, formatting and converting dates, times and timestamps

  • dateutil

    Extensions to the standard Python module

  • pendulum

    Python datetimes made easy

  • pytz

    World timezone definitions, modern and historical. Brings the into Python

Debugging Tools / pdb-like Debugger

  • ipdb

    IPython-enabled

  • pudb

    A full-screen, console-based Python debugger

Debugging Tools / Tracing

  • manhole

    Debugging UNIX socket connections and present the stacktraces for all threads and an interactive prompt

  • python-hunter

    A flexible code tracing toolkit

Debugging Tools / Profiler

  • py-spy

    A sampling profiler for Python programs. Written in Rust

  • vprof

    Visual Python profiler

Debugging Tools / Others

  • django-debug-toolbar

    Display various debug information for Django

  • flask-debugtoolbar

    A port of the django-debug-toolbar to flask

  • icecream

    Inspect variables, expressions, and program execution with a single, simple function call

  • pyelftools

    Parsing and analyzing ELF files and DWARF debugging information

Deep Learning

  • keras

    A high-level neural networks library and capable of running on top of either TensorFlow or Theano

  • pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

  • pytorch-lightning

    Deep learning framework to train, deploy, and ship AI products Lightning fast

  • stable-baselines3

    PyTorch implementations of Stable Baselines (deep) reinforcement learning algorithms

  • tensorflow

    The most popular Deep Learning framework created by Google

  • theano

    A library for fast numerical computation

DevOps Tools / Configuration Management

  • ansible

    A radically simple IT automation platform

  • cloudinit

    A multi-distribution package that handles early initialization of a cloud instance

  • openstack

    Open source software for building private and public clouds

  • pyinfra

    A versatile CLI tools and python libraries to automate infrastructure

  • saltstack

    Infrastructure automation and management system

DevOps Tools / SSH-style Deployment

  • cuisine

    Chef-like functionality for Fabric

  • fabric

    A simple, Pythonic tool for remote execution and deployment

DevOps Tools / Process Management

  • supervisor

    Supervisor process control system for UNIX

DevOps Tools / Monitoring

  • psutil

    A cross-platform process and system utilities module

DevOps Tools / Backup

  • borg

    A deduplicating archiver with compression and encryption

Distributed Computing / Batch Processing

  • dask

    A flexible parallel computing library for analytic computing

  • luigi

    A module that helps you build complex pipelines of batch jobs

  • PySpark

    Python API

  • Ray

    A system for parallel and distributed Python that unifies the machine learning ecosystem

Distributed Computing / Stream Processing

  • faust

    A stream processing library, porting the ideas from to Python

  • streamparse

    Run Python code against real-time streams of data via

Distribution

  • py2app

    Freezes Python scripts (Mac OS X)

  • py2exe

    Freezes Python scripts (Windows)

  • pyarmor

    A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts

  • pyinstaller

    Converts Python programs into stand-alone executables (cross-platform)

  • shiv

    A command line utility for building fully self-contained zipapps (PEP 441), but with all their dependencies included

Documentation

  • sphinx

    Python Documentation generator

Documentation / sphinx

Documentation

  • pdoc

    Epydoc replacement to auto generate API documentation for Python libraries

Downloader

  • akshare

    A financial data interface library, built for human beings!

  • s3cmd

    A command line tool for managing Amazon S3 and CloudFront

  • youtube-dl

    A command-line program to download videos from YouTube and other video sites

Editor Plugins and IDEs / Emacs

  • elpy

    Emacs Python Development Environment

Editor Plugins and IDEs / Vim

  • jedi-vim

    Vim bindings for the Jedi auto-completion library for Python

  • python-mode

    An all in one plugin for turning Vim into a Python IDE

  • YouCompleteMe

    Includes -based completion engine for Python

Editor Plugins and IDEs / Visual Studio

  • PTVS

    Python Tools for Visual Studio

Editor Plugins and IDEs / Visual Studio Code

  • Python

    The official VSCode extension with rich support for Python

Editor Plugins and IDEs / IDE

  • PyCharm

    Commercial Python IDE by JetBrains. Has free community edition available

  • spyder

    Open Source Python IDE

Email / Mail Servers

  • modoboa

    A mail hosting and management platform including a modern Web UI

  • salmon

    A Python Mail Server

Email / Clients

  • imbox

    Python IMAP for Humans

  • yagmail

    Yet another Gmail/SMTP client

Email / Others

  • flanker

    An email address and Mime parsing library

  • mailer

    High-performance extensible mail delivery framework

Environment Management

  • pyenv

    Simple Python version management

  • virtualenv

    A tool to create isolated Python environments

File Manipulation

  • mimetypes

    (Python standard library) Map filenames to MIME types

  • pathlib

    (Python standard library) An cross-platform, object-oriented path library

  • path.py

    A module wrapper for

  • python-magic

    A Python interface to the libmagic file type identification library

  • watchdog

    API and shell utilities to monitor file system events

Functional Programming

  • coconut

    A variant of Python built for simple, elegant, Pythonic functional programming

  • funcy

    A fancy and practical functional tools

  • more-itertools

    More routines for operating on iterables, beyond

  • returns

    A set of type-safe monads, transformers, and composition utilities

  • cytoolz

    Cython implementation of : High performance functional utilities

  • toolz

    A collection of functional utilities for iterators, functions, and dictionaries

GUI Development

  • curses

    Built-in wrapper for used to create terminal GUI applications

  • Eel

    A library for making simple Electron-like offline HTML/JS GUI apps

  • enaml

    Creating beautiful user-interfaces with Declarative Syntax like QML

  • Flexx

    Flexx is a pure Python toolkit for creating GUI's, that uses web technology for its rendering

  • Gooey

    Turn command line programs into a full GUI application with one line

  • kivy

    A library for creating NUI applications, running on Windows, Linux, Mac OS X, Android and iOS

  • pyglet

    A cross-platform windowing and multimedia library for Python

  • PyGObject

    Python Bindings for GLib/GObject/GIO/GTK+ (GTK+3)

  • PyQt

    Python bindings for the cross-platform application and UI framework

  • PySimpleGUI

    Wrapper for tkinter, Qt, WxPython and Remi

  • pywebview

    A lightweight cross-platform native wrapper around a webview component

  • Tkinter

    Tkinter is Python's de-facto standard GUI package

  • Toga

    A Python native, OS native GUI toolkit

  • urwid

    A library for creating terminal GUI applications with strong support for widgets, events, rich colors, etc

  • wxPython

    A blending of the wxWidgets C++ class library with the Python

  • DearPyGui

    A Simple GPU accelerated Python GUI framework

GraphQL

  • graphene

    GraphQL framework for Python

Game Development

  • Arcade

    Arcade is a modern Python framework for crafting games with compelling graphics and sound

  • Cocos2d

    cocos2d is a framework for building 2D games, demos, and other graphical/interactive applications

  • Harfang3D

    Python framework for 3D, VR and game development

  • Panda3D

    3D game engine developed by Disney

  • Pygame

    Pygame is a set of Python modules designed for writing games

  • PyOgre

    Python bindings for the Ogre 3D render engine, can be used for games, simulations, anything 3D

  • PyOpenGL

    Python ctypes bindings for OpenGL and it's related APIs

  • PySDL2

    A ctypes based wrapper for the SDL2 library

  • RenPy

    A Visual Novel engine

Geolocation

  • django-countries

    A Django app that provides a country field for models and forms

  • geodjango

    A world-class geographic web framework

  • geojson

    Python bindings and utilities for GeoJSON

  • geopy

    Python Geocoding Toolbox

HTML Manipulation

  • beautifulsoup

    Providing Pythonic idioms for iterating, searching, and modifying HTML or XML

  • bleach

    A whitelist-based HTML sanitization and text linkification library

  • cssutils

    A CSS library for Python

  • html5lib

    A standards-compliant library for parsing and serializing HTML documents and fragments

  • lxml

    A very fast, easy-to-use and versatile library for handling HTML and XML

  • markupsafe

    Implements a XML/HTML/XHTML Markup safe string for Python

  • pyquery

    A jQuery-like library for parsing HTML

  • untangle

    Converts XML documents to Python objects for easy access

  • WeasyPrint

    A visual rendering engine for HTML and CSS that can export to PDF

  • xmldataset

    Simple XML Parsing

  • xmltodict

    Working with XML feel like you are working with JSON

HTTP Clients

  • httpx

    A next generation HTTP client for Python

  • requests

    HTTP Requests for Humans

  • treq

    Python requests like API built on top of Twisted's HTTP client

  • urllib3

    A HTTP library with thread-safe connection pooling, file post support, sanity friendly

Hardware

  • keyboard

    Hook and simulate global keyboard events on Windows and Linux

  • mouse

    Hook and simulate global mouse events on Windows and Linux

  • pynput

    A library to control and monitor input devices

  • scapy

    A brilliant packet manipulation library

Image Processing

  • pillow

    Pillow is the friendly fork

  • python-barcode

    Create barcodes in Python with no extra dependencies

  • pymatting

    A library for alpha matting

  • python-qrcode

    A pure Python QR Code generator

  • pywal

    A tool that generates color schemes from images

  • pyvips

    A fast image processing library with low memory needs

  • quads

    Computer art based on quadtrees

  • scikit-image

    A Python library for (scientific) image processing

  • thumbor

    A smart imaging service. It enables on-demand crop, re-sizing and flipping of images

  • wand

    Python bindings for , C API for ImageMagick

Implementations

  • cython

    Optimizing Static Compiler for Python

  • clpython

    Implementation of the Python programming language written in Common Lisp

  • ironpython

    Implementation of the Python programming language written in C#

  • micropython

    A lean and efficient Python programming language implementation

  • numba

    Python JIT compiler to LLVM aimed at scientific Python

  • peachpy

    x86-64 assembler embedded in Python

  • pypy

    A very fast and compliant implementation of the Python language

  • pyston

    A Python implementation using JIT techniques

Interactive Interpreter

  • bpython

    A fancy interface to the Python interpreter

  • Jupyter Notebook (IPython)

    A rich toolkit to help you make the most out of using Python interactively

Interactive Interpreter / Jupyter Notebook (IPython)

Interactive Interpreter

  • ptpython

    Advanced Python REPL built on top of the

Internationalization

  • Babel

    An internationalization library for Python

  • PyICU

    A wrapper of International Components for Unicode C++ library ( )

Job Scheduler

  • Airflow

    Airflow is a platform to programmatically author, schedule and monitor workflows

  • APScheduler

    A light but powerful in-process task scheduler that lets you schedule functions

  • django-schedule

    A calendaring app for Django

  • doit

    A task runner and build tool

  • gunnery

    Multipurpose task execution tool for distributed systems with web-based interface

  • Joblib

    A set of tools to provide lightweight pipelining in Python

  • Plan

    Writing crontab file in Python like a charm

  • Prefect

    A modern workflow orchestration framework that makes it easy to build, schedule and monitor robust data pipelines

  • schedule

    Python job scheduling for humans

  • Spiff

    A powerful workflow engine implemented in pure Python

  • TaskFlow

    A Python library that helps to make task execution easy, consistent and reliable

Logging

  • logbook

    Logging replacement for Python

  • logging

    (Python standard library) Logging facility for Python

  • loguru

    Library which aims to bring enjoyable logging in Python

  • sentry-python

    Sentry SDK for Python

  • structlog

    Structured logging made easy

Machine Learning

  • gym

    A toolkit for developing and comparing reinforcement learning algorithms

  • H2O

    Open Source Fast Scalable Machine Learning Platform

  • Metrics

    Machine learning evaluation metrics

  • NuPIC

    Numenta Platform for Intelligent Computing

  • scikit-learn

    The most popular Python library for Machine Learning

  • Spark ML

    's scalable Machine Learning library

  • vowpal_porpoise

    A lightweight Python wrapper for

  • xgboost

    A scalable, portable, and distributed gradient boosting library

  • MindsDB

    MindsDB is an open source AI layer for existing databases that allows you to effortlessly develop, train and deploy state-of-the-art machine learning models using standard queries

Microsoft Windows

  • Python(x,y)

    Scientific-applications-oriented Python Distribution based on Qt and Spyder

  • pythonlibs

    Unofficial Windows binaries for Python extension packages

  • PythonNet

    Python Integration with the .NET Common Language Runtime (CLR)

  • PyWin32

    Python Extensions for Windows

  • WinPython

    Portable development environment for Windows 7/8

Miscellaneous

  • blinker

    A fast Python in-process signal/event dispatching system

  • boltons

    A set of pure-Python utilities

  • itsdangerous

    Various helpers to pass trusted data to untrusted environments

  • magenta

    A tool to generate music and art using artificial intelligence

  • pluginbase

    A simple but flexible plugin system for Python

  • tryton

    A general purpose business framework

Natural Language Processing / General

  • gensim

    Topic Modeling for Humans

  • langid.py

    Stand-alone language identification system

  • nltk

    A leading platform for building Python programs to work with human language data

  • pattern

    A web mining module

  • polyglot

    Natural language pipeline supporting hundreds of languages

  • pytext

    A natural language modeling framework based on PyTorch

  • PyTorch-NLP

    A toolkit enabling rapid deep learning NLP prototyping for research

  • spacy

    A library for industrial-strength natural language processing in Python and Cython

  • Stanza

    The Stanford NLP Group's official Python library, supporting 60+ languages

Natural Language Processing / Chinese

  • funNLP

    A collection of tools and datasets for Chinese NLP

  • jieba

    The most popular Chinese text segmentation library

  • pkuseg-python

    A toolkit for Chinese word segmentation in various domains

  • snownlp

    A library for processing Chinese text

Network Virtualization

  • mininet

    A popular network emulator and API written in Python

  • napalm

    Cross-vendor API to manipulate network devices

  • pox

    A Python-based SDN control applications, such as OpenFlow SDN controllers

News Feed

  • django-activity-stream

    Generating generic activity streams from the actions on your site

  • Stream Framework

    Building news feed and notification systems using Cassandra and Redis

ORM / Relational Databases

ORM / Relational Databases / SQLAlchemy

ORM / Relational Databases

  • dataset

    Store Python dicts in a database - works with SQLite, MySQL, and PostgreSQL

  • orator

    The Orator ORM provides a simple yet beautiful ActiveRecord implementation

  • orm

    An async ORM

  • peewee

    A small, expressive ORM

  • pony

    ORM that provides a generator-oriented interface to SQL

  • pydal

    A pure Python Database Abstraction Layer

ORM / NoSQL Databases

  • hot-redis

    Rich Python data types for Redis

  • mongoengine

    A Python Object-Document-Mapper for working with MongoDB

  • PynamoDB

    A Pythonic interface for

  • redisco

    A Python Library for Simple Models and Containers Persisted in Redis

Package Management

  • pip

    The package installer for Python

Package Management / pip

  • pip-tools

    A set of tools to keep your pinned Python dependencies fresh

Package Management

  • conda

    Cross-platform, Python-agnostic binary package manager

  • poetry

    Python dependency management and packaging made easy

Package Repositories

  • bandersnatch

    PyPI mirroring tool provided by Python Packaging Authority (PyPA)

  • devpi

    PyPI server and packaging/testing/release tool

  • localshop

    Local PyPI server (custom packages and auto-mirroring of pypi)

  • warehouse

    Next generation Python Package Repository (PyPI)

Penetration Testing

  • fsociety

    A Penetration testing framework

  • setoolkit

    A toolkit for social engineering

  • sqlmap

    Automatic SQL injection and database takeover tool

Permissions

  • django-guardian

    Implementation of per object permissions for Django 1.2+

  • django-rules

    A tiny but powerful app providing object-level permissions to Django, without requiring a database

Processes

  • delegator.py

    for Humans 2.0

  • sarge

    Yet another wrapper for subprocess

  • sh

    A full-fledged subprocess replacement for Python

Recommender Systems

  • annoy

    Approximate Nearest Neighbors in C++/Python optimized for memory usage

  • fastFM

    A library for Factorization Machines

  • implicit

    A fast Python implementation of collaborative filtering for implicit datasets

  • libffm

    A library for Field-aware Factorization Machine (FFM)

  • lightfm

    A Python implementation of a number of popular recommendation algorithms

  • spotlight

    Deep recommender models using PyTorch

  • Surprise

    A scikit for building and analyzing recommender systems

  • tensorrec

    A Recommendation Engine Framework in TensorFlow

Refactoring

  • Bicycle Repair Man

    Bicycle Repair Man, a refactoring tool for Python

  • Bowler

    Safe code refactoring for modern Python

  • Rope

    Rope is a python refactoring library

RESTful API / Django

RESTful API / Flask

  • eve

    REST API framework powered by Flask, MongoDB and good intentions

  • flask-api

    Browsable Web APIs for Flask

  • flask-restful

    Quickly building REST APIs for Flask

RESTful API / Pyramid

  • cornice

    A RESTful framework for Pyramid

RESTful API / Framework agnostic

  • falcon

    A high-performance framework for building cloud APIs and web app backends

  • fastapi

    A modern, fast, web framework for building APIs with Python 3.6+ based on standard Python type hints

  • hug

    A Python 3 framework for cleanly exposing APIs

  • sandman2

    Automated REST APIs for existing database-driven systems

  • sanic

    A Python 3.6+ web server and web framework that's written to go fast

Robotics

  • PythonRobotics

    This is a compilation of various robotics algorithms with visualizations

  • rospy

    This is a library for ROS (Robot Operating System)

RPC Servers

  • RPyC

    (Remote Python Call) - A transparent and symmetric RPC library for Python

  • zeroRPC

    zerorpc is a flexible RPC implementation based on and

Science

  • astropy

    A community Python library for Astronomy

  • bcbio-nextgen

    Providing best-practice pipelines for fully automated high throughput sequencing analysis

  • bccb

    Collection of useful code related to biological analysis

  • Biopython

    Biopython is a set of freely available tools for biological computation

  • cclib

    A library for parsing and interpreting the results of computational chemistry packages

  • Colour

    Implementing a comprehensive number of colour theory transformations and algorithms

  • Karate Club

    Unsupervised machine learning toolbox for graph structured data

  • NetworkX

    A high-productivity software for complex networks

  • NIPY

    A collection of neuroimaging toolkits

  • NumPy

    A fundamental package for scientific computing with Python

  • ObsPy

    A Python toolbox for seismology

  • Open Babel

    A chemical toolbox designed to speak the many languages of chemical data

  • PyDy

    Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion

  • PyMC

    Markov Chain Monte Carlo sampling toolkit

  • QuTiP

    Quantum Toolbox in Python

  • RDKit

    Cheminformatics and Machine Learning Software

  • SciPy

    A Python-based ecosystem of open-source software for mathematics, science, and engineering

  • SimPy

    A process-based discrete-event simulation framework

  • statsmodels

    Statistical modeling and econometrics in Python

  • SymPy

    A Python library for symbolic mathematics

  • Zipline

    A Pythonic algorithmic trading library

Serialization

  • marshmallow

    A lightweight library for converting complex objects to and from simple Python datatypes

  • pysimdjson

    A Python bindings for

  • python-rapidjson

    A Python wrapper around

  • ultrajson

    A fast JSON decoder and encoder written in C with Python bindings

Serverless Frameworks

  • python-lambda

    A toolkit for developing and deploying Python code in AWS Lambda

  • Zappa

    A tool for deploying WSGI applications on AWS Lambda and API Gateway

Shell

  • xonsh

    A Python-powered, cross-platform, Unix-gazing shell language and command prompt

Specific Formats Processing / General

  • tablib

    A module for Tabular Datasets in XLS, CSV, JSON, YAML

Specific Formats Processing / Office

  • docxtpl

    Editing a docx document by jinja2 template

  • openpyxl

    A library for reading and writing Excel 2010 xlsx/xlsm/xltx/xltm files

  • pyexcel

    Providing one API for reading, manipulating and writing csv, ods, xls, xlsx and xlsm files

  • python-docx

    Reads, queries and modifies Microsoft Word 2007/2008 docx files

  • python-pptx

    Python library for creating and updating PowerPoint (.pptx) files

  • unoconv

    Convert between any document format supported by LibreOffice/OpenOffice

  • XlsxWriter

    A Python module for creating Excel .xlsx files

  • xlwings

    A BSD-licensed library that makes it easy to call Python from Excel and vice versa

  • xlwt

    / - Writing and reading data and formatting information from Excel files

Specific Formats Processing / PDF

  • pdfminer.six

    Pdfminer.six is a community maintained fork of the original PDFMiner

  • PyPDF2

    A library capable of splitting, merging and transforming PDF pages

  • ReportLab

    Allowing Rapid creation of rich PDF documents

Specific Formats Processing / Markdown

  • Mistune

    Fastest and full featured pure Python parsers of Markdown

  • Python-Markdown

    A Python implementation of John Gruber’s Markdown

Specific Formats Processing / YAML

  • PyYAML

    YAML implementations for Python

Specific Formats Processing / CSV

  • csvkit

    Utilities for converting to and working with CSV

Specific Formats Processing / Archive

  • unp

    A command line tool that can unpack archives easily

Static Site Generator

  • lektor

    An easy to use static CMS and blog engine

  • mkdocs

    Markdown friendly documentation generator

  • makesite

    Simple, lightweight, and magic-free static site/blog generator (< 130 lines)

  • nikola

    A static website and blog generator

  • pelican

    Static site generator that supports Markdown and reST syntax

Tagging

Task Queues

  • celery

    An asynchronous task queue/job queue based on distributed message passing

  • dramatiq

    A fast and reliable background task processing library for Python 3

  • huey

    Little multi-threaded task queue

  • mrq

    A distributed worker task queue in Python using Redis & gevent

  • rq

    Simple job queues for Python

Template Engine

  • Genshi

    Python templating toolkit for generation of web-aware output

  • Jinja2

    A modern and designer friendly templating language

  • Mako

    Hyperfast and lightweight templating for the Python platform

Testing / Testing Frameworks

  • hypothesis

    Hypothesis is an advanced Quickcheck style property based testing library

  • nose2

    The successor to , based on `unittest2

  • pytest

    A mature full-featured Python testing tool

  • Robot Framework

    A generic test automation framework

  • unittest

    (Python standard library) Unit testing framework

Testing / Test Runners

  • green

    A clean, colorful test runner

  • mamba

    The definitive testing tool for Python. Born under the banner of BDD

  • tox

    Auto builds and tests distributions in multiple Python versions

Testing / GUI / Web Testing

  • locust

    Scalable user load testing tool written in Python

  • PyAutoGUI

    PyAutoGUI is a cross-platform GUI automation Python module for human beings

  • Schemathesis

    A tool for automatic property-based testing of web applications built with Open API / Swagger specifications

  • Selenium

    Python bindings for WebDriver

  • sixpack

    A language-agnostic A/B Testing framework

  • splinter

    Open source tool for testing web applications

Testing / Mock

  • doublex

    Powerful test doubles framework for Python

  • freezegun

    Travel through time by mocking the datetime module

  • httmock

    A mocking library for requests for Python 2.6+ and 3.2+

  • httpretty

    HTTP request mock tool for Python

  • mock

    (Python standard library) A mocking and patching library

  • mocket

    A socket mock framework with gevent/asyncio/SSL support

  • responses

    A utility library for mocking out the requests Python library

  • VCR.py

    Record and replay HTTP interactions on your tests

Testing / Object Factories

  • factory_boy

    A test fixtures replacement for Python

  • mixer

    Another fixtures replacement. Supports Django, Flask, SQLAlchemy, Peewee and etc

  • model_mommy

    Creating random fixtures for testing in Django

Testing / Code Coverage

Testing / Fake Data

  • fake2db

    Fake database generator

  • faker

    A Python package that generates fake data

  • mimesis

    is a Python library that help you generate fake data

  • radar

    Generate random datetime / time

Text Processing / General

  • chardet

    Python 2/3 compatible character encoding detector

  • difflib

    (Python standard library) Helpers for computing deltas

  • ftfy

    Makes Unicode text less broken and more consistent automagically

  • fuzzywuzzy

    Fuzzy String Matching

  • Levenshtein

    Fast computation of Levenshtein distance and string similarity

  • pangu.py

    Paranoid text spacing

  • pyfiglet

    An implementation of figlet written in Python

  • pypinyin

    Convert Chinese hanzi (漢字) to pinyin (拼音)

  • textdistance

    Compute distance between sequences with 30+ algorithms

  • unidecode

    ASCII transliterations of Unicode text

Text Processing / Slugify

  • awesome-slugify

    A Python slugify library that can preserve unicode

  • python-slugify

    A Python slugify library that translates unicode to ASCII

  • unicode-slugify

    A slugifier that generates unicode slugs with Django as a dependency

Text Processing / Unique identifiers

  • hashids

    Implementation of in Python

  • shortuuid

    A generator library for concise, unambiguous and URL-safe UUIDs

Text Processing / Parser

  • ply

    Implementation of lex and yacc parsing tools for Python

  • pygments

    A generic syntax highlighter

  • pyparsing

    A general purpose framework for generating parsers

  • python-nameparser

    Parsing human names into their individual components

  • python-phonenumbers

    Parsing, formatting, storing and validating international phone numbers

  • python-user-agents

    Browser user agent parser

  • sqlparse

    A non-validating SQL parser

Third-party APIs

URL Manipulation

  • furl

    A small Python library that makes parsing and manipulating URLs easy

  • purl

    A simple, immutable URL class with a clean API for interrogation and manipulation

  • pyshorteners

    A pure Python URL shortening lib

  • webargs

    A friendly library for parsing HTTP request arguments with built-in support for popular web frameworks

Video

  • moviepy

    A module for script-based movie editing with many formats, including animated GIFs

  • scikit-video

    Video processing routines for SciPy

  • vidgear

    Most Powerful multi-threaded Video Processing framework

Web Asset Management

  • django-compressor

    Compresses linked and inline JavaScript or CSS into a single cached file

  • django-pipeline

    An asset packaging library for Django

  • django-storages

    A collection of custom storage back ends for Django

  • fanstatic

    Packages, optimizes, and serves static file dependencies as Python packages

  • fileconveyor

    A daemon to detect and sync files to CDNs, S3 and FTP

  • flask-assets

    Helps you integrate webassets into your Flask app

  • webassets

    Bundles, optimizes, and manages unique cache-busting URLs for static resources

Web Content Extracting

  • html2text

    Convert HTML to Markdown-formatted text

  • lassie

    Web Content Retrieval for Humans

  • micawber

    A small library for extracting rich content from URLs

  • newspaper

    News extraction, article extraction and content curation in Python

  • python-readability

    Fast Python port of arc90's readability tool

  • requests-html

    Pythonic HTML Parsing for Humans

  • sumy

    A module for automatic summarization of text documents and HTML pages

  • textract

    Extract text from any document, Word, PowerPoint, PDFs, etc

  • toapi

    Every web site provides APIs

Web Crawling

  • feedparser

    Universal feed parser

  • grab

    Site scraping framework

  • mechanicalsoup

    A Python library for automating interaction with websites

  • scrapy

    A fast high-level screen scraping and web crawling framework

Web Frameworks / Synchronous

  • django

    The most popular web framework in Python

Web Frameworks / Synchronous / django

Web Frameworks / Synchronous

  • flask

    A microframework for Python

Web Frameworks / Synchronous / flask

Web Frameworks / Synchronous

  • pyramid

    A small, fast, down-to-earth, open source Python web framework

Web Frameworks / Synchronous / pyramid

Web Frameworks / Synchronous

  • masonite

    The modern and developer centric Python web framework

Web Frameworks / Asynchronous

  • tornado

    A web framework and asynchronous networking library

WebSocket

  • autobahn-python

    WebSocket & WAMP for Python on Twisted and

  • channels

    Developer-friendly asynchrony for Django

  • websockets

    A library for building WebSocket servers and clients with a focus on correctness and simplicity

WSGI Servers

  • gunicorn

    Pre-forked, ported from Ruby's Unicorn project

  • uwsgi

    A project aims at developing a full stack for building hosting services, written in C

  • waitress

    Multi-threaded, powers Pyramid

  • werkzeug

    A WSGI utility library for Python that powers Flask and can easily be embedded into your own projects

Resources / Newsletters

Resources / Podcasts

More related projects

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.