Awesome-Pytorch-list
Contents
- Pytorch & related libraries
- Tutorials, books & examples
- Paper implementations
- Talks & Conferences
- Pytorch elsewhere
Pytorch & related libraries
- pytorch: Tensors and Dynamic neural networks in Python with strong GPU acceleration.
- Captum: Model interpretability and understanding for PyTorch.
NLP & Speech Processing:
- pytorch text: Torch text related contents.
- pytorch-seq2seq: A framework for sequence-to-sequence (seq2seq) models implemented in PyTorch.
- anuvada: Interpretable Models for NLP using PyTorch.
- audio: simple audio I/O for pytorch.
- loop: A method to generate speech across multiple speakers
- fairseq-py: Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
- speech: PyTorch ASR Implementation.
- OpenNMT-py: Open-Source Neural Machine Translation in PyTorch http://opennmt.net
- neuralcoref: State-of-the-art coreference resolution based on neural nets and spaCy huggingface.co/coref
- sentiment-discovery: Unsupervised Language Modeling at scale for robust sentiment classification.
- MUSE: A library for Multilingual Unsupervised or Supervised word Embeddings
- nmtpytorch: Neural Machine Translation Framework in PyTorch.
- pytorch-wavenet: An implementation of WaveNet with fast generation
- Tacotron-pytorch: Tacotron: Towards End-to-End Speech Synthesis.
- AllenNLP: An open-source NLP research library, built on PyTorch.
- PyTorch-NLP: Text utilities and datasets for PyTorch pytorchnlp.readthedocs.io
- quick-nlp: Pytorch NLP library based on FastAI.
- TTS: Deep learning for Text2Speech
- LASER: Language-Agnostic SEntence Representations
- pyannote-audio: Neural building blocks for speaker diarization: speech activity detection, speaker change detection, speaker embedding
- gensen: Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning.
- translate: Translate - a PyTorch Language Library.
- espnet: End-to-End Speech Processing Toolkit espnet.github.io/espnet
- pythia: A software suite for Visual Question Answering
- UnsupervisedMT: Phrase-Based & Neural Unsupervised Machine Translation.
- jiant: The jiant sentence representation learning toolkit.
- BERT-PyTorch: Pytorch implementation of Google AI's 2018 BERT, with simple annotation
- InferSent: Sentence embeddings (InferSent) and training code for NLI.
- uis-rnn:This is the library for the Unbounded Interleaved-State Recurrent Neural Network (UIS-RNN) algorithm, corresponding to the paper Fully Supervised Speaker Diarization. arxiv.org/abs/1810.04719
- flair: A very simple framework for state-of-the-art Natural Language Processing (NLP)
- pytext: A natural language modeling framework based on PyTorch fb.me/pytextdocs
- voicefilter: Unofficial PyTorch implementation of Google AI's VoiceFilter system http://swpark.me/voicefilter
- BERT-NER: Pytorch-Named-Entity-Recognition-with-BERT.
- transfer-nlp: NLP library designed for flexible research and development
- texar-pytorch: Toolkit for Machine Learning and Text Generation, in PyTorch texar.io
- pytorch-kaldi: pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.
- NeMo: Neural Modules: a toolkit for conversational AI nvidia.github.io/NeMo
- pytorch-struct: A library of vectorized implementations of core structured prediction algorithms (HMM, Dep Trees, CKY, ..,)
- espresso: Espresso: A Fast End-to-End Neural Speech Recognition Toolkit
- transformers: huggingface Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch. huggingface.co/transformers
- reformer-pytorch: Reformer, the efficient Transformer, in Pytorch
- torch-metrics: Metrics for model evaluation in pytorch
- speechbrain: SpeechBrain is an open-source and all-in-one speech toolkit based on PyTorch.
- Backprop: Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.
CV:
- pytorch vision: Datasets, Transforms and Models specific to Computer Vision.
- pt-styletransfer: Neural style transfer as a class in PyTorch.
- OpenFacePytorch: PyTorch module to use OpenFace's nn4.small2.v1.t7 model
- img_classification_pk_pytorch: Quickly comparing your image classification models with the state-of-the-art models (such as DenseNet, ResNet, ...)
- SparseConvNet: Submanifold sparse convolutional networks.
- Convolution_LSTM_pytorch: A multi-layer convolution LSTM module
- face-alignment: :fire: 2D and 3D Face alignment library build using pytorch adrianbulat.com
- pytorch-semantic-segmentation: PyTorch for Semantic Segmentation.
- RoIAlign.pytorch: This is a PyTorch version of RoIAlign. This implementation is based on crop_and_resize and supports both forward and backward on CPU and GPU.
- pytorch-cnn-finetune: Fine-tune pretrained Convolutional Neural Networks with PyTorch.
- detectorch: Detectorch - detectron for PyTorch
- Augmentor: Image augmentation library in Python for machine learning. http://augmentor.readthedocs.io
- s2cnn: This library contains a PyTorch implementation of the SO(3) equivariant CNNs for spherical signals (e.g. omnidirectional cameras, signals on the globe)
- TorchCV: A PyTorch-Based Framework for Deep Learning in Computer Vision.
- maskrcnn-benchmark: Fast, modular reference implementation of Instance Segmentation and Object Detection algorithms in PyTorch.
- image-classification-mobile: Collection of classification models pretrained on the ImageNet-1K.
- medicaltorch: A medical imaging framework for Pytorch http://medicaltorch.readthedocs.io
- albumentations: Fast image augmentation library.
- kornia: Differentiable computer vision library.
- pytorch-text-recognition: Text recognition combo - CRAFT + CRNN.
- facenet-pytorch: Pretrained Pytorch face detection and recognition models ported from davidsandberg/facenet.
- detectron2: Detectron2 is FAIR's next-generation research platform for object detection and segmentation.
- vedaseg: A semantic segmentation framework by pyotrch
- ClassyVision: An end-to-end PyTorch framework for image and video classification.
- detecto:Computer vision in Python with less than 10 lines of code
- pytorch3d: PyTorch3D is FAIR's library of reusable components for deep learning with 3D data pytorch3d.org
- MMDetection: MMDetection is an open source object detection toolbox, a part of the OpenMMLab project.
- neural-dream: A PyTorch implementation of the DeepDream algorithm. Creates dream-like hallucinogenic visuals.
- FlashTorch: Visualization toolkit for neural networks in PyTorch!
- Lucent: Tensorflow and OpenAI Clarity's Lucid adapted for PyTorch.
- MMDetection3D: MMDetection3D is OpenMMLab's next-generation platform for general 3D object detection, a part of the OpenMMLab project.
- MMSegmentation: MMSegmentation is a semantic segmentation toolbox and benchmark, a part of the OpenMMLab project.
- MMEditing: MMEditing is a image and video editing toolbox, a part of the OpenMMLab project.
- MMAction2: MMAction2 is OpenMMLab's next generation action understanding toolbox and benchmark, a part of the OpenMMLab project.
- MMPose: MMPose is a pose estimation toolbox and benchmark, a part of the OpenMMLab project.
- lightly - Lightly is a computer vision framework for self-supervised learning.
- RoMa: a lightweight and efficient library to deal with 3D rotations.
Probabilistic/Generative Libraries:
- ptstat: Probabilistic Programming and Statistical Inference in PyTorch
- pyro: Deep universal probabilistic programming with Python and PyTorch http://pyro.ai
- probtorch: Probabilistic Torch is library for deep generative models that extends PyTorch.
- paysage: Unsupervised learning and generative models in python/pytorch.
- pyvarinf: Python package facilitating the use of Bayesian Deep Learning methods with Variational Inference for PyTorch.
- pyprob: A PyTorch-based library for probabilistic programming and inference compilation.
- mia: A library for running membership inference attacks against ML models.
- pro_gan_pytorch: ProGAN package implemented as an extension of PyTorch nn.Module.
- botorch: Bayesian optimization in PyTorch
Other libraries:
- pytorch extras: Some extra features for pytorch.
- functional zoo: PyTorch, unlike lua torch, has autograd in it's core, so using modular structure of torch.nn modules is not necessary, one can easily allocate needed Variables and write a function that utilizes them, which is sometimes more convenient. This repo contains model definitions in this functional way, with pretrained weights for some models.
- torch-sampling: This package provides a set of transforms and data structures for sampling from in-memory or out-of-memory data.
- torchcraft-py: Python wrapper for TorchCraft, a bridge between Torch and StarCraft for AI research.
- aorun: Aorun intend to be a Keras with PyTorch as backend.
- logger: A simple logger for experiments.
- PyTorch-docset: PyTorch docset! use with Dash, Zeal, Velocity, or LovelyDocs.
- convert_torch_to_pytorch: Convert torch t7 model to pytorch model and source.
- pretrained-models.pytorch: The goal of this repo is to help to reproduce research papers results.
- pytorch_fft: PyTorch wrapper for FFTs
- caffe_to_torch_to_pytorch
- pytorch-extension: This is a CUDA extension for PyTorch which computes the Hadamard product of two tensors.
- tensorboard-pytorch: This module saves PyTorch tensors in tensorboard format for inspection. Currently supports scalar, image, audio, histogram features in tensorboard.
- gpytorch: GPyTorch is a Gaussian Process library, implemented using PyTorch. It is designed for creating flexible and modular Gaussian Process models with ease, so that you don't have to be an expert to use GPs.
- spotlight: Deep recommender models using PyTorch.
- pytorch-cns: Compressed Network Search with PyTorch
- pyinn: CuPy fused PyTorch neural networks ops
- inferno: A utility library around PyTorch
- pytorch-fitmodule: Super simple fit method for PyTorch modules
- inferno-sklearn: A scikit-learn compatible neural network library that wraps pytorch.
- pytorch-caffe-darknet-convert: convert between pytorch, caffe prototxt/weights and darknet cfg/weights
- pytorch2caffe: Convert PyTorch model to Caffemodel
- pytorch-tools: Tools for PyTorch
- sru: Training RNNs as Fast as CNNs (arxiv.org/abs/1709.02755)
- torch2coreml: Torch7 -> CoreML
- PyTorch-Encoding: PyTorch Deep Texture Encoding Network http://hangzh.com/PyTorch-Encoding
- pytorch-ctc: PyTorch-CTC is an implementation of CTC (Connectionist Temporal Classification) beam search decoding for PyTorch. C++ code borrowed liberally from TensorFlow with some improvements to increase flexibility.
- candlegp: Gaussian Processes in Pytorch.
- dpwa: Distributed Learning by Pair-Wise Averaging.
- dni-pytorch: Decoupled Neural Interfaces using Synthetic Gradients for PyTorch.
- skorch: A scikit-learn compatible neural network library that wraps pytorch
- ignite: Ignite is a high-level library to help with training neural networks in PyTorch.
- Arnold: Arnold - DOOM Agent
- pytorch-mcn: Convert models from MatConvNet to PyTorch
- simple-faster-rcnn-pytorch: A simplified implemention of Faster R-CNN with competitive performance.
- generative_zoo: generative_zoo is a repository that provides working implementations of some generative models in PyTorch.
- pytorchviz: A small package to create visualizations of PyTorch execution graphs.
- cogitare: Cogitare - A Modern, Fast, and Modular Deep Learning and Machine Learning framework in Python.
- pydlt: PyTorch based Deep Learning Toolbox
- semi-supervised-pytorch: Implementations of different VAE-based semi-supervised and generative models in PyTorch.
- pytorch_cluster: PyTorch Extension Library of Optimised Graph Cluster Algorithms.
- neural-assembly-compiler: A neural assembly compiler for pyTorch based on adaptive-neural-compilation.
- caffemodel2pytorch: Convert Caffe models to PyTorch.
- extension-cpp: C++ extensions in PyTorch
- pytoune: A Keras-like framework and utilities for PyTorch
- jetson-reinforcement: Deep reinforcement learning libraries for NVIDIA Jetson TX1/TX2 with PyTorch, OpenAI Gym, and Gazebo robotics simulator.
- matchbox: Write PyTorch code at the level of individual examples, then run it efficiently on minibatches.
- torch-two-sample: A PyTorch library for two-sample tests
- pytorch-summary: Model summary in PyTorch similar to
model.summary()
in Keras - mpl.pytorch: Pytorch implementation of MaxPoolingLoss.
- scVI-dev: Development branch of the scVI project in PyTorch
- apex: An Experimental PyTorch Extension(will be deprecated at a later point)
- ELF: ELF: a platform for game research.
- Torchlite: A high level library on top of(not only) Pytorch
- joint-vae: Pytorch implementation of JointVAE, a framework for disentangling continuous and discrete factors of variation star2
- SLM-Lab: Modular Deep Reinforcement Learning framework in PyTorch.
- bindsnet: A Python package used for simulating spiking neural networks (SNNs) on CPUs or GPUs using PyTorch
- pro_gan_pytorch: ProGAN package implemented as an extension of PyTorch nn.Module
- pytorch_geometric: Geometric Deep Learning Extension Library for PyTorch
- torchplus: Implements the + operator on PyTorch modules, returning sequences.
- lagom: lagom: A light PyTorch infrastructure to quickly prototype reinforcement learning algorithms.
- torchbearer: torchbearer: A model training library for researchers using PyTorch.
- pytorch-maml-rl: Reinforcement Learning with Model-Agnostic Meta-Learning in Pytorch.
- NALU: Basic pytorch implementation of NAC/NALU from Neural Arithmetic Logic Units paper by trask et.al arxiv.org/pdf/1808.00508.pdf
- QuCumber: Neural Network Many-Body Wavefunction Reconstruction
- magnet: Deep Learning Projects that Build Themselves http://magnet-dl.readthedocs.io/
- opencv_transforms: OpenCV implementation of Torchvision's image augmentations
- fastai: The fast.ai deep learning library, lessons, and tutorials
- pytorch-dense-correspondence: Code for "Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation" arxiv.org/pdf/1806.08756.pdf
- colorization-pytorch: PyTorch reimplementation of Interactive Deep Colorization richzhang.github.io/ideepcolor
- beauty-net: A simple, flexible, and extensible template for PyTorch. It's beautiful.
- OpenChem: OpenChem: Deep Learning toolkit for Computational Chemistry and Drug Design Research mariewelt.github.io/OpenChem
- torchani: Accurate Neural Network Potential on PyTorch aiqm.github.io/torchani
- PyTorch-LBFGS: A PyTorch implementation of L-BFGS.
- gpytorch: A highly efficient and modular implementation of Gaussian Processes in PyTorch.
- hessian: hessian in pytorch.
- vel: Velocity in deep-learning research.
- nonechucks: Skip bad items in your PyTorch DataLoader, use Transforms as Filters, and more!
- torchstat: Model analyzer in PyTorch.
- QNNPACK: Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators.
- torchdiffeq: Differentiable ODE solvers with full GPU support and O(1)-memory backpropagation.
- redner: A differentiable Monte Carlo path tracer
- pixyz: a library for developing deep generative models in a more concise, intuitive and extendable way.
- euclidesdb: A multi-model machine learning feature embedding database http://euclidesdb.readthedocs.io
- pytorch2keras: Convert PyTorch dynamic graph to Keras model.
- salad: Semi-Supervised Learning and Domain Adaptation.
- netharn: Parameterized fit and prediction harnesses for pytorch.
- dgl: Python package built to ease deep learning on graph, on top of existing DL frameworks. http://dgl.ai.
- gandissect: Pytorch-based tools for visualizing and understanding the neurons of a GAN. gandissect.csail.mit.edu
- delira: Lightweight framework for fast prototyping and training deep neural networks in medical imaging delira.rtfd.io
- mushroom: Python library for Reinforcement Learning experiments.
- Xlearn: Transfer Learning Library
- geoopt: Riemannian Adaptive Optimization Methods with pytorch optim
- vegans: A library providing various existing GANs in PyTorch.
- torchgeometry: TGM: PyTorch Geometry
- AdverTorch: A Toolbox for Adversarial Robustness (attack/defense/training) Research
- AdaBound: An optimizer that trains as fast as Adam and as good as SGD.a
- fenchel-young-losses: Probabilistic classification in PyTorch/TensorFlow/scikit-learn with Fenchel-Young losses
- pytorch-OpCounter: Count the FLOPs of your PyTorch model.
- Tor10: A Generic Tensor-Network library that is designed for quantum simulation, base on the pytorch.
- Catalyst: High-level utils for PyTorch DL & RL research. It was developed with a focus on reproducibility, fast experimentation and code/ideas reusing. Being able to research/develop something new, rather than write another regular train loop.
- Ax: Adaptive Experimentation Platform
- pywick: High-level batteries-included neural network training library for Pytorch
- torchgpipe: A GPipe implementation in PyTorch torchgpipe.readthedocs.io
- hub: Pytorch Hub is a pre-trained model repository designed to facilitate research reproducibility.
- pytorch-lightning: Rapid research framework for Pytorch. The researcher's version of keras.
- Tor10: A Generic Tensor-Network library that is designed for quantum simulation, base on the pytorch.
- tensorwatch: Debugging, monitoring and visualization for Deep Learning and Reinforcement Learning from Microsoft Research.
- wavetorch: Numerically solving and backpropagating through the wave equation arxiv.org/abs/1904.12831
- diffdist: diffdist is a python library for pytorch. It extends the default functionality of torch.autograd and adds support for differentiable communication between processes.
- torchprof: A minimal dependency library for layer-by-layer profiling of Pytorch models.
- osqpth: The differentiable OSQP solver layer for PyTorch.
- mctorch: A manifold optimization library for deep learning.
- pytorch-hessian-eigenthings: Efficient PyTorch Hessian eigendecomposition using the Hessian-vector product and stochastic power iteration.
- MinkowskiEngine: Minkowski Engine is an auto-diff library for generalized sparse convolutions and high-dimensional sparse tensors.
- pytorch-cpp-rl: PyTorch C++ Reinforcement Learning
- pytorch-toolbelt: PyTorch extensions for fast R&D prototyping and Kaggle farming
- argus-tensor-stream: A library for real-time video stream decoding to CUDA memory tensorstream.argus-ai.com
- macarico: learning to search in pytorch
- rlpyt: Reinforcement Learning in PyTorch
- pywarm: A cleaner way to build neural networks for PyTorch. blue-season.github.io/pywarm
- learn2learn: PyTorch Meta-learning Framework for Researchers http://learn2learn.net
- torchbeast: A PyTorch Platform for Distributed RL
- higher: higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.
- Torchelie: Torchélie is a set of utility functions, layers, losses,