harbor

LLM toolkit

An all-in-one toolkit for running Large Language Models and associated services from the command line.

Effortlessly run LLM backends, APIs, frontends, and services with one command.

GitHub

507 stars
8 watching
33 forks
Language: TypeScript
last commit: 11 days ago
aibashclicontainerdockerdocker-composeexl2ggufllmlocalnpmpackagepypisafetensorsself-hostedtooltools

Related projects:

Repository Description Stars
aiplanethub/beyondllm An open-source toolkit for building and evaluating large language models 261
simpleai-team/simpleai Provides tools and utilities for implementing various artificial intelligence algorithms 968
melih-unsal/demogpt A comprehensive toolset for building Large Language Model (LLM) based applications 1,710
aaronik/gptmodels.nvim An AI plugin for Neovim that provides a stable and user-friendly interface for integrating Large Language Models into the editor. 58
blib-la/hyv A versatile library designed to streamline the integration and interaction of diverse AI models for collaborative software development 21
reid41/shell-pilot A lightweight shell script to interact with various AI models and their APIs from the terminal. 69
kevincoble/aitoolbox A toolbox of AI modules written in Swift for various machine learning tasks and algorithms 794
blob42/instrukt An integrated AI environment in the terminal for building, testing, and instructing agents. 278
seaof0/csplugins A collection of PowerShell scripts and modules for automating tasks and extending functionality. 17
flagai-open/aquila2 Provides pre-trained language models and tools for fine-tuning and evaluation 437
axflow/axflow An end-to-end framework for building robust natural language powered applications in TypeScript 1,106
mmuller88/alf-cdk-api-gw An AWS CDK project for deploying an API Gateway with TypeScript and CloudFormation 0
aidc-ai/parrot A method and toolkit for fine-tuning large language models to perform visual instruction tasks in multiple languages. 30
alienvault-labs/alienvaultlabs A collection of experimental projects and tools focused on threat intelligence, security research, and incident response 510
run-llama/llamaindexts A data framework for integrating large language models into applications with custom data 1,937