Elon Musk’s updated Grok AI claims to be better at coding and math

Key Points:

  • Grok-1.5 has improved capabilities and can process longer contexts
  • Grok-1.5 shows significant improvements in math and coding benchmarks
  • Grok-1.5 can process up to 128K tokens within its context window, increasing memory capacity


Elon Musk’s artificial intelligence company, xAI, has unveiled an update for its chatbot named Grok-1.5, aimed at enhancing its capabilities in math, coding, and overall reasoning. The upgraded version boasts improved performance, with significant advancements in MATH benchmark scores, math word problems, and coding evaluations. xAI indicates that Grok-1.5 now competes closely with leading AI models like GPT-4, Gemini Pro 1.5, and Claude 3 Opus across various metrics.


Grok-1.5 has demonstrated remarkable progress, achieving a substantially higher score in the MATH benchmark, more than double its previous performance. Noteworthy improvements were also seen in the GSM8K and HumanEval evaluations, placing Grok-1.5 in a competitive position among its industry peers. The chatbot can now process longer contexts of up to 128K tokens, allowing it to analyze and comprehend information from extended documents, providing a richer understanding of different scenarios.


While xAI has focused on highlighting Grok-1.5’s advancements, there are areas where it may still lag behind, such as academic scores and multimodal capabilities. Additionally, the company faces upcoming competition from ChatGPT 5, expected to debut this summer with features promising more human-like interactions. Currently, access to Grok is limited to Premium+ tier users on the X platform, but Musk has pledged to make it available to regular Premium customers as well.


Notably, xAI recently made headlines by open-sourcing its Grok chatbot after a legal dispute with OpenAI and Sam Altman regarding the organization’s non-profit mission. The decision to open source Grok reflects xAI’s commitment to fostering transparency and collaboration within the AI community. This move also aligns with Musk’s vision to democratize access to advanced AI technologies, ensuring broader participation and innovation in the field.



Prompt Engineering Guides



©2024 The Horizon