haystack

LLM orchestrator

An AI orchestration framework to build customizable LLM applications with advanced retrieval methods.

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

GitHub

18k stars
143 watching
2k forks
Language: Python
last commit: 6 days ago
Linked from 10 awesome lists

aibertchatgptgenerative-aigpt-3information-retrievallanguage-modellarge-language-modelsllmmachine-learningnlppythonpytorchquestion-answeringragretrieval-augmented-generationsemantic-searchsquadsummarizationtransformers

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
deepset-ai/haystack-core-integrations Extensions to Haystack's document store and embedder capabilities for NLP tasks. 118
activeloopai/deeplake A Database for AI that stores and manages various data types used in deep learning applications. 8,171
llmware-ai/llmware A framework for building enterprise LLM-based applications using small, specialized models 6,651
ludwig-ai/ludwig A low-code framework for building custom deep learning models and neural networks 11,189
deepset-ai/farm An open-source framework for adapting representation models to various tasks and industries 1,741
confident-ai/deepeval A framework for evaluating large language models 3,669
ai-hypercomputer/maxtext A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. 1,529
pathwaycom/llm-app Pre-built templates for integrating large language models into enterprise applications with real-time data APIs and various data sources. 4,642
towhee-io/towhee A framework for building efficient neural data processing pipelines using large language models and state-of-the-art deep learning models. 3,226
aiplanethub/beyondllm An open-source toolkit for building and evaluating large language models 261
microsoft/lmops A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models. 3,695
langgenius/dify An open-source LLM app development platform that enables users to build and deploy AI-powered applications quickly and efficiently. 51,873
trypromptly/llmstack A tool for building and deploying generative AI applications with a no-code multi-agent framework 1,610
dicklesworthstone/swiss_army_llama A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures. 941
deepchecks/deepchecks A suite of tools and components for testing and validating machine learning models and data in various stages of development and deployment. 3,623