Introducing DBRX: A New State-of-the-Art Open LLM
Databricks has unveiled DBRX, an innovative large language model (LLM) that surpasses established open LLMs in benchmarks, outperforming models like GPT-3.5 and challenging GPT-4. DBRX’s state-of-the-art capabilities are highlighted by its fine-grained mixture-of-experts (MoE) architecture, leading to improvements in training and inference performance. It excels in tasks ranging from language understanding to programming and mathematics. […]