Prompt-Highlighter

Text controller

An interactive control system for text generation in multi-modal language models

[CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs

GitHub

132 stars
2 watching
2 forks
Language: Python
last commit: 4 months ago
llm-inferencemulti-modalitytext-generation

Related projects:

Repository Description Stars
ailab-cvc/seed An implementation of a multimodal language model with capabilities for comprehension and generation 576
dvlab-research/lisa A system that uses large language models to generate segmentation masks for images based on complex queries and world knowledge. 1,861
ailab-cvc/seed-bench A benchmark for evaluating large language models' ability to process multimodal input 315
dvlab-research/llama-vid An image-based language model that uses large language models to generate visual and text features from videos 733
wisconsinaivision/vip-llava A system designed to enable large multimodal models to understand arbitrary visual prompts 294
rasulomaroff/reactive.nvim A plugin for Neovim that applies dynamic highlights and window coloring based on mode changes and operator usage. 197
dgenzer/suricata-highlight-vscode A language colorizer extension for Visual Studio Code that highlights Suricata rules syntax 12
kasama/nvim-custom-diagnostic-highlight A plugin to apply custom highlights to diagnostics in a code editor 59
soolab/ddcot This implementation provides tools and methods for multimodal reasoning in language models through prompting. 33
mr-lllll/interestingwords.nvim A plugin for highlighting and navigating through multiple words in a buffer. 44
tony-xlh/capacitor-plugin-dynamsoft-label-recognizer A Capacitor plugin that provides text recognition functionality 2
vimalabs/vima An implementation of a general-purpose robot learning model using multimodal prompts 774
nvlabs/prismer A deep learning framework for training multi-modal models with vision and language capabilities. 1,298
sy-xuan/pink This project enables multi-modal language models to understand and generate text about visual content using referential comprehension. 76
echasnovski/mini.hipatterns Provides a flexible way to highlight patterns in text with customizable options 99