llm-app

AI app templates

Provides pre-built AI application templates to integrate Large Language Models (LLMs) with various data sources for scalable RAG and enterprise search.

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

GitHub

5k stars
32 watching
236 forks
last commit: 1 day ago
Linked from 2 awesome lists

chatbothugging-facellmllm-localllm-promptingllm-securityllmopsmachine-learningopen-aipathwayragreal-timeretrieval-augmented-generationvector-databasevector-index

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
llmware-ai/llmware A framework for building enterprise LLM-based applications using small, specialized models 8,223
langgenius/dify An open-source LLM app development platform that enables users to build and deploy AI-powered applications quickly and efficiently. 53,528
promptfoo/promptfoo A tool for testing and evaluating large language models (LLMs) to ensure they are reliable and secure 4,899
langstream/langstream An event-driven developer platform for building and running large language model AI apps 396
zilliztech/gptcache A semantic cache designed to reduce the cost and improve the speed of LLM API calls by storing responses. 7,266
explodinggradients/ragas A toolkit for evaluating and optimizing Large Language Model applications with data-driven insights 7,421
deepset-ai/haystack An AI orchestration framework to build customizable LLM applications with advanced retrieval methods. 17,919
pathwaycom/pathway A Python-based ETL framework for stream processing and real-time analytics with a scalable Rust engine. 4,402
mintplex-labs/anything-llm A full-stack application that enables users to turn any document into context for chatting with various Large Language Models (LLMs) and vector databases 27,975
bricks-cloud/bricksllm An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring 926
langfuse/langfuse An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools. 6,875
scisharp/llamasharp A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices 2,715
truefoundry/cognita A modular framework for building production-ready AI applications with integrated data management and model deployment capabilities 3,355
infiniflow/ragflow An RAG (Retrieval-Augmented Generation) engine based on deep document understanding for generating truthful question-answering capabilities. 24,405
llm-workflow-engine/llm-workflow-engine A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4. 3,670