grok-1

MoE model

An implementation of a Mixture of Experts (MoE) model with large parameters and specialized features for natural language processing tasks.

Grok open release

GitHub

50k stars
589 watching
8k forks
Language: Python
last commit: about 2 years ago

Related projects:

RepositoryDescriptionStars
sanchit-gandhi/whisper-jaxAn optimized implementation of OpenAI's Whisper Model for speech recognition and speech-to-text tasks using JAX.4,467
karpathy/mingptA minimal PyTorch implementation of a transformer-based language model20,474
openai/baselinesHigh-quality implementations of reinforcement learning algorithms for research and development purposes15,885
openai/tiktokenA fast and efficient tokeniser for natural language models based on Byte Pair Encoding (BPE)12,703
gradio-app/gradioEnables rapid creation and deployment of web applications for machine learning models and functions using Python34,557
ricklamers/gpt-code-uiAn interactive code generation and execution tool using AI models3,567
openai/gpt-2A repository providing code and models for research into language modeling and multitask learning22,644
brexhq/prompt-engineeringGuides software developers on how to effectively use and build systems around Large Language Models like GPT-4.8,487
minimaxir/gpt-2-simpleA tool for retraining and fine-tuning the OpenAI GPT-2 text generation model on new datasets.3,398
openai/gymA toolkit for developing and comparing reinforcement learning algorithms using a standardized API to interact with environments.34,966
openai/whisperA general-purpose speech recognition system trained on large-scale weak supervision72,752
ktr0731/evansA gRPC client library with two modes: REPL and CLI, providing automatic service inspection and task automation4,304
openai/consistency_modelsA PyTorch-based framework for training and sampling consistency models in image generation6,199
eriklindernoren/pytorch-yolov3An implementation of YOLOv3 in PyTorch for object detection and tracking7,343
flagai-open/flagaiAn open-source toolkit for training and deploying large-scale AI models on various downstream tasks with multi-modality3,840