ex_llama

Chat model wrapper

Provides Elixir bindings for interacting with a machine learning chat model using C++

Elixir NIFs for interacting with llama_cpp.rust managed GGUF models.

GitHub

8 stars
2 watching
0 forks
Language: Elixir
last commit: 7 months ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
noizu-labs-ml/elixir-openai An Elixir wrapper for the OpenAI API 5
noizu-labs-ml/elixir-weaviate A library providing a simple wrapper around Weaviate's API calls for Elixir developers 1
noizu-labs-ml/genai A GenAI framework that provides an interface to multiple AI providers and models through a standardized API 18
snunez1/llama.cl A Common Lisp port of a Large Language Model (LLM) implementation 35
thmsmlr/instructor_ex A library that provides structured outputs for Large Language Models (LLMs) in Elixir 558
git-cloner/llama2-lora-fine-tuning Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset. 167
run-llama/llamaindexts A data framework for integrating large language models into applications with custom data 1,937
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
zhyu/nadia A Telegram Bot API wrapper written in Elixir 364
ecnu-icalk/educhat A large-scale language model-based chatbot system for intelligent education 713
trustatom-oss/elixir-fluent-client A lightweight client library for interacting with the FluentD message bus 8
maximilian-winter/llama-cpp-agent A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. 493
kendryte/toucan-llm A large language model with 70 billion parameters designed for chatbot and conversational AI tasks 29
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 253
linksoul-ai/chinese-llama-2-7b A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data 2,228