Prompt-Highlighter

Text controller

An interactive control system for text generation in multi-modal language models

[CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs

GitHub

135 stars
2 watching
2 forks
Language: Python
last commit: about 2 years ago
llm-inferencemulti-modalitytext-generation

Related projects:

RepositoryDescriptionStars
ailab-cvc/seedAn implementation of a multimodal language model with capabilities for comprehension and generation585
dvlab-research/lisaA system that uses large language models to generate segmentation masks for images based on complex queries and world knowledge.1,923
ailab-cvc/seed-benchA benchmark for evaluating large language models' ability to process multimodal input322
dvlab-research/llama-vidAn image-based language model that uses large language models to generate visual and text features from videos748
wisconsinaivision/vip-llavaA system designed to enable large multimodal models to understand arbitrary visual prompts302
rasulomaroff/reactive.nvimA plugin for Neovim that applies dynamic highlights and window coloring based on mode changes and operator usage.202
dgenzer/suricata-highlight-vscodeA language colorizer extension for Visual Studio Code that highlights Suricata rules syntax12
kasama/nvim-custom-diagnostic-highlightA plugin to apply custom highlights to diagnostics in a code editor59
soolab/ddcotThis implementation provides tools and methods for multimodal reasoning in language models through prompting.35
mr-lllll/interestingwords.nvimA plugin for highlighting and navigating through multiple words in a buffer.44
tony-xlh/capacitor-plugin-dynamsoft-label-recognizerA Capacitor plugin that provides text recognition functionality2
vimalabs/vimaAn implementation of a general-purpose robot learning model using multimodal prompts781
nvlabs/prismerA deep learning framework for training multi-modal models with vision and language capabilities.1,299
sy-xuan/pinkThis project enables multi-modal language models to understand and generate text about visual content using referential comprehension.79
echasnovski/mini.hipatternsProvides a flexible way to highlight patterns in text with customizable options109