Grok-1, developed by Elon Musk’s xAI startup, is now accessible as an open-source model, available for integration into commercial applications.
With a sizeable 314 billion parameters, Grok-1 operates on a Mixture of Experts (MoE) system, utilizing multiple expert networks to generate responses to queries.
Unlike models tailored for specific tasks, Grok-1 offers a flexible foundation for users to expand upon, facilitating further development and customization.
Surpassing the scale of the popular open-source model Llama 2 by over four times, Grok-1 necessitates a sufficient GPU memory for testing.
Designed to provide a unique challenge to conversational AI platforms like ChatGPT, Grok-1 draws inspiration from the ethos of the Hitchhiker’s Guide to the Galaxy, promising to explore new avenues of AI interaction.
“It is intended to answer almost anything and, far harder, even suggest what questions to ask,” developers said.
It took for XAI only four months to build the model.
It’s nased on its Apache 2.0 license. Business users can use Grok to build commercial applications.
Elon Musk believes that it is better for AI safety that research is kept open.
Grok model is available for download at https://github.com/xai-org/grok-1
References
https://grok.x.ai/
https://x.ai/blog/grok-os
https://aibusiness.com/nlp/elon-musk-s-ai-startup-xai-opens-grok-for-business