howto100m
Text-Video Embedding Toolkit
Provides code and tools for learning joint text-video embeddings using the HowTo100M dataset
Code for the HowTo100M paper
254 stars
5 watching
37 forks
Language: Python
last commit: almost 5 years ago
Linked from 1 awesome list
Related projects:
Repository | Description | Stars |
---|---|---|
| An open-source implementation of the Mixture-of-Embeddings-Experts model in Pytorch for video-text retrieval tasks. | 118 |
| A collection of pre-trained models and code for training paraphrastic sentence embeddings from large machine translation datasets. | 102 |
| Evaluates and benchmarks large language models' video understanding capabilities | 121 |
| Provides a tool to easily embed videos and generate thumbnails in Django web applications. | 19 |
| This project enables text-to-video generation using a combination of pixel and latent diffusion models. | 1,110 |
| Embeds YouTube and Vimeo videos into GitHub markdown with ease using an API and website | 82 |
| A utility class for generating and evaluating document representations using word embeddings. | 54 |
| A codebase for training and using models of sentence embeddings. | 33 |
| Unsupervised word embeddings capture latent knowledge from materials science literature | 624 |
| A framework for learning sentence embeddings from matrices | 21 |
| A library for embedding video content from YouTube, Vimeo, and Dailymotion in web applications. | 56 |
| Transforms video content into a long document containing visual and audio information that can be used for chat or other applications. | 545 |
| An implementation of a deep learning-based image representation learning approach using a modified fully connected layer and transfer learning from VGG16 | 34 |
| Trains word embeddings from a paraphrase database to represent semantic relationships between words. | 30 |
| PyTorch implementation of video question answering system based on TVQA dataset | 172 |