llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
AI summary
LLM interface
A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output.
- stars
- 505
- forks
- 51
- watching
- 13
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
LLM agent
Builds agents controlled by large language models (LLMs) to perform tasks with tool-based components
LLM API
An API that provides a unified interface to multiple large language models for chat fine-tuning
LLM interface
An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities.
LLM library
A Common Lisp port of a Large Language Model (LLM) implementation
LLM integrator
A data framework for integrating large language models into applications with custom data
agenta-ai/agenta1.6K
LLM platform
An end-to-end platform for building and deploying large language model applications
LLaMA binder
A C++ library providing Java bindings to Facebook's LLaMA model for natural language processing tasks.
AI agent framework
A framework and benchmark for training and evaluating multi-modal large language models, enabling the development of AI agents capable of seamless interaction between humans and machines.
internlm/lagent1.9K
LLM agent framework
A lightweight framework for building agent-based applications using LLMs and transformer architectures
LLM toolkit
A comprehensive toolset for building Large Language Model (LLM) based applications
LLM server
Provides an HTTP API server for integrating Large Language Models into applications
LLM server
A framework for serving large language models with a robust and efficient API
LLM Agent Papers
A collection of papers on the use of large language models in agent-based systems
LLM integrator
A tool to integrate Large Language Models into Python code seamlessly
LLaMA binder
A WebAssembly binding for the LLaMA model that enables on-browser inference without requiring a backend or GPU.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions llama-cpp-agent.
