# Grok-1 开源发布

- 来源：xAI：News（网页）
- 发布时间：2024-03-17 08:00
- AIHOT 链接：https://aihot.virxact.com/items/cmnwsvjei005zsltewwq09h7x
- 原文链接：https://x.ai/news/grok-os

## AI 摘要

xAI 宣布开源 Grok-1 模型权重，采用 Apache 2.0 协议。该模型拥有 3140 亿参数，基于 MoE 架构，是迄今参数量最大的开源大模型之一。权重已上传至 GitHub 和 Hugging Face，可自由下载用于本地部署与商用。

## 正文

**We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.**

This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue.

We are releasing the weights and the architecture under the Apache 2.0 license.

To get started with using the model, follow the instructions at github.com/xai-org/grok. Model Details Base model trained on a large amount of text data, not fine-tuned for any particular task. **314B** parameter Mixture-of-Experts model with 25% of the weights active on a given token. Trained from scratch by xAI using a custom training stack on top of JAX and Rust in October 2023.