xAI officially releases Grok-1 source code

Musk’s artificial intelligence company xAI announced the open access of the weights and architecture of its 314 billion parameter hybrid expert model Grok-1. Grok-1 is a large language model trained from scratch by xAI, using a hybrid expert model architecture where 25% of the weights are active on a given token. The model's basic model weights and network architecture are now available under the Apache 2.0 license.