xAI open sources the base model weights and network architecture of Grok-1, a 314B parameter Mixture-of-Experts model, under the Apache 2.0 license (x.ai)

x.ai:

xAI open sources the base model weights and network architecture of Grok-1, a 314B parameter Mixture-of-Experts model, under the Apache 2.0 license  —  We are releasing the base model weights and network architecture of Grok-1, our large language model.  Grok-1 is a 314 billion parameter Mixture …