Elon Musk AI Grok:
- Elon Musk’s AI chatbot, Grok, is a product of his company xAI.
- Grok was born to dominate the chatbot market with a bit different approach from others.
- xAI has released the weights and architecture of its large language model Grok-1, official via a blog post.
Elon Musk’s xAI has announced the open-sourcing of its generative AI chatbot, Grok, fulfilling a promise made by its founder approximately a week ago. Shortly after making Grok AI open source, Musk took aim at OpenAI, stirring up tensions that have been ongoing since the billionaire sued his former company earlier this month.
Weights and Architecture of Grok-1
xAI announced the open-sourcing of Grok in a blog post, saying: “We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI. This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue.”
With 314 billion parameters trained, compared to 70 billion for Llama 2 and 12 billion for Mistral 8x7B, Grok outperforms many other companies that offer open-source language models, such as Meta’s Llama 2 and Mistral 8x7B.
According to Venture Beats, Grok is available under the Apache Licence 2.0, which permits distribution, modification, and use for commercial reasons. However, trademarks is not register yet against it, which means users aren’t entitle to any warranties or liability. Moreover, Last November, Musk introduced Grok AI as a rival in the chatbot market.
The chatbot, Grook uniqueness lies in to responding the queries with a “rebellious streak” and a hint of humour, from Douglas Adams’ science fiction book ‘The Hitchhiker’s Guide to the Galaxy’. Up until now, users had to pay ₹1300 per month or ₹13,600 annually for an X Premium+ subscription in order to access Grok.
ALSO READ: Apple and Google Shaking Hands for the New Gemini AI Features
Thanks for Reading! Stay Tune 🙂