ex_llama

Chat model wrapper

Provides Elixir bindings for interacting with a machine learning chat model using C++

Elixir NIFs for interacting with llama_cpp.rust managed GGUF models.

GitHub

10 stars
2 watching
0 forks
Language: Elixir
last commit: 9 months ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
noizu-labs-ml/elixir-openai An Elixir wrapper for the OpenAI API 5
noizu-labs-ml/elixir-weaviate A library providing a simple wrapper around Weaviate's API calls for Elixir developers 2
noizu-labs-ml/genai A GenAI framework that provides an interface to multiple AI providers and models through a standardized API 19
snunez1/llama.cl A Common Lisp port of a Large Language Model (LLM) implementation 36
thmsmlr/instructor_ex A library that provides structured outputs for Large Language Models (LLMs) in Elixir 587
git-cloner/llama2-lora-fine-tuning Fine-tuning the LLaMA 2 chat model using DeepSpeed and Lora for improved performance on a large dataset. 171
run-llama/llamaindexts A data framework for integrating large language models into applications with custom data 1,997
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
zhyu/nadia A Telegram Bot API wrapper written in Elixir 364
ecnu-icalk/educhat An open-source educational chat model that enables intelligent education through conversational interfaces. 730
trustatom-oss/elixir-fluent-client A lightweight client library for interacting with the FluentD message bus 8
maximilian-winter/llama-cpp-agent A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. 505
kendryte/toucan-llm A large language model with 70 billion parameters designed for chatbot and conversational AI tasks 29
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 256
linksoul-ai/chinese-llama-2-7b A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data 2,235