llama-cpp-agent
LLM interface
A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output.
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
501 stars
12 watching
51 forks
Language: Python
last commit: 4 months ago
Linked from 1 awesome list
agentsfunction-callingllamacppllmllm-agentllm-frameworkllmsparallel-function-call
kyrolabs/awesome-langchainRelated projects:
| Repository | Description | Stars |
|---|---|---|
 mpaepper/llm_agents | Builds agents controlled by large language models (LLMs) to perform tasks with tool-based components | 935 |
 victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |
 jpmcb/nvim-llama | An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. | 262 |
 snunez1/llama.cl | A Common Lisp port of a Large Language Model (LLM) implementation | 36 |
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,976 |
 agenta-ai/agenta | An end-to-end platform for building and deploying large language model applications | 1,309 |
 kherud/java-llama.cpp | A C++ library providing Java bindings to Facebook's LLaMA model for natural language processing tasks. | 316 |
 opengvlab/lamm | A framework and benchmark for training and evaluating multi-modal large language models, enabling the development of AI agents capable of seamless interaction between humans and machines. | 303 |
 internlm/lagent | A lightweight framework for building agent-based applications using LLMs and transformer architectures | 1,890 |
 melih-unsal/demogpt | A comprehensive toolset for building Large Language Model (LLM) based applications | 1,726 |
 sangyuxiaowu/llamaworker | Provides an HTTP API server for integrating Large Language Models into applications | 48 |
 msoedov/langcorn | A framework for serving large language models with a robust and efficient API | 907 |
 zjunlp/llmagentpapers | A collection of papers on the use of large language models in agent-based systems | 1,907 |
 jackmpcollins/magentic | A tool to integrate Large Language Models into Python code seamlessly | 2,077 |
 ngxson/wllama | A WebAssembly binding for the LLaMA model that enables on-browser inference without requiring a backend or GPU. | 451 |