llm-app

AI app templates

Provides pre-built AI application templates to integrate Large Language Models (LLMs) with various data sources for scalable RAG and enterprise search.

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

GitHub

7k stars
31 watching
253 forks
last commit: about 1 month ago
Linked from 2 awesome lists

chatbothugging-facellmllm-localllm-promptingllm-securityllmopsmachine-learningopen-aipathwayragreal-timeretrieval-augmented-generationvector-databasevector-index

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
llmware-ai/llmware A framework for building enterprise LLM-based applications using small, specialized models 8,303
langgenius/dify An open-source LLM app development platform that enables users to build and deploy AI-powered applications quickly and efficiently. 54,931
promptfoo/promptfoo A tool for testing and evaluating large language models (LLMs) to ensure they are reliable and secure 4,976
langstream/langstream An event-driven developer platform for building and running large language model AI apps 398
zilliztech/gptcache A semantic cache designed to reduce the cost and improve the speed of LLM API calls by storing responses. 7,293
explodinggradients/ragas A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations. 7,598
deepset-ai/haystack An AI orchestration framework to build customizable LLM applications with advanced retrieval methods. 18,094
pathwaycom/pathway A Python-based ETL framework for stream processing and real-time analytics with a scalable Rust engine. 7,174
mintplex-labs/anything-llm An all-in-one Desktop & Docker AI application with built-in RAG and support for multiple LLMs and vector databases. 28,746
bricks-cloud/bricksllm An enterprise-grade API gateway for LLMs with fine-grained access control and monitoring 938
langfuse/langfuse An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools. 7,123
scisharp/llamasharp An efficient C#/.NET library for running Large Language Models (LLMs) on local devices 2,750
truefoundry/cognita A modular framework for building production-ready AI applications with integrated data management and model deployment capabilities 3,401
infiniflow/ragflow An RAG (Retrieval-Augmented Generation) engine based on deep document understanding to provide truthful question-answering capabilities. 25,479
llm-workflow-engine/llm-workflow-engine A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4. 3,674