DeepSeek-MoE
by deepseek-ai
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
AI summary
Efficient LLM
A large language model with improved efficiency and performance compared to similar models
- stars
- 1K
- forks
- 53
- watching
- 16
Similar projects
Found by comparing what the projects do, not just their names.
LLM
A large language model trained on a massive dataset for various applications
Vision-Language Model
A multimodal AI model that enables real-world vision-language understanding applications
Language model
An implementation of a fast and efficient language model architecture
Code generator
A code intelligence model designed to generate and complete code in various programming languages
LLM
An open-source implementation of a vision-language instructed large language model
LM Benchmark
A benchmark for evaluating large language models in multiple languages and formats
LLM framework
A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs.
Language model toolkit
A guide to using pre-trained large language models in source code analysis and generation
Language Model
An implementation of a neural network model for character-level language modeling.
Mixture of Experts Model
A large vision-language model using a mixture-of-experts architecture to improve performance on multi-modal learning tasks
Feature reuse accelerator
A novel paradigm to accelerate diffusion models by reusing and updating high-level features in a cheap way
LLM agent
Builds agents controlled by large language models (LLMs) to perform tasks with tool-based components
LLM toolkit
An open-source toolkit for building and evaluating large language models
Deep Learning Models
Provides a collection of deep learning models and utilities in JAX/Flax for research purposes.
Mixture-of-Experts Model
Developed by XVERSE Technology Inc. as a multilingual large language model with a unique mixture-of-experts architecture and fine-tuned for various tasks such as conversation, question answering, and natural language understanding.
