bertviz
Attention visualizer
An interactive tool for visualizing attention in Transformer language models.
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
7k stars
73 watching
790 forks
Language: Python
last commit: over 1 year ago bertgpt2machine-learningnatural-language-processingneural-networknlppytorchrobertatransformertransformersvisualization
Related projects:
| Repository | Description | Stars |
|---|---|---|
 codertimo/bert-pytorch | An implementation of Google's 2018 BERT model in PyTorch, allowing pre-training and fine-tuning for natural language processing tasks | 6,251 |
 ashishpatel26/tools-to-design-or-visualize-architecture-of-neural-network | Tools to aid in designing and visualizing neural network architectures | 4,525 |
 maartengr/bertopic | This tool allows developers to extract and analyze topics from large text datasets using transformer-based models and topic modeling techniques. | 6,246 |
 google-research/bert | Provides pre-trained models and code for natural language processing tasks using TensorFlow | 38,374 |
 diego999/pygat | An implementation of the Graph Attention Network model using PyTorch. | 2,935 |
 poloclub/cnn-explainer | An interactive visualization system to help non-experts learn about Convolutional Neural Networks (CNNs) by visualizing the learning process. | 8,204 |
 openai/transformer-debugger | An open-source tool that helps investigate specific behaviors of small language models by combining automated interpretability techniques with sparse autoencoders. | 4,047 |
 philipperemy/keras-attention | A Keras layer implementing an attention mechanism for natural language processing tasks | 2,803 |
 szagoruyko/pytorchviz | A tool to visualize PyTorch execution graphs and traces | 3,251 |
 petarv-/gat | An implementation of Graph Attention Networks in TensorFlow for graph representation learning. | 3,261 |
| poloclub/transformer-explainer | An interactive visualization tool to help users understand how large language models like GPT work | 3,604 |
 laurentmazare/ocaml-bert | Implementing BERT-like NLP models in OCaml using PyTorch bindings and pre-trained weights from popular sources. | 24 |
 nlintz/tensorflow-tutorials | A collection of tutorials teaching deep learning with TensorFlow using Jupyter Notebooks | 6,003 |
 jadore801120/attention-is-all-you-need-pytorch | An implementation of the Transformer model in PyTorch, a deep learning framework for sequence-to-sequence tasks like language translation. | 8,936 |
 brightmart/roberta_zh | Implements RoBERTa for Chinese pre-training using TensorFlow and provides PyTorch versions for loading and training | 2,638 |