Databricks Launches DBRX
Empowers organizations to build production-quality generative AI applications efficiently and gives them control over their data.
Note: TDWI's editors carefully choose vendor-issued press releases about new or upgraded products and services. We have edited and/or condensed this release to highlight key features but make no claims as to the accuracy of the vendor's statements.
Databricks, the data and AI company, has launched DBRX, a general-purpose large language model (LLM). DBRX democratizes the training and tuning of custom, high-performing LLMs so every enterprise no longer needs to rely on a small handful of closed models. Available today, DBRX enables organizations to cost-effectively build, train, and serve their own custom LLMs.
"At Databricks, our vision has always been to democratize data and AI. We're doing that by delivering data intelligence to every enterprise — helping them understand and use their private data to build their own AI systems," said Ali Ghodsi, co-founder and CEO at Databricks. "DBRX uses a mixture-of-experts architecture, making the model extremely fast in terms of tokens per second, as well as being cost effective to serve. DBRX gives enterprises a platform to build customized reasoning capabilities based on their own data."
DBRX Efficiency
DBRX was developed by Mosaic AI and trained on NVIDIA DGX Cloud. Databricks optimized DBRX for efficiency with a mixture-of-experts (MoE) architecture built on the MegaBlocks open source project. The resulting model has leading performance and is compute-efficient.
DBRX enables customizable and transparent generative AI for all enterprises. A recent survey from Andreessen Horowitz found that nearly 60 percent of AI leaders are interested in increasing open source usage or switching when fine-tuned open source models roughly match performance of closed source models. In 2024 and beyond, enterprises expect a significant shift of usage from closed towards open source. Databricks believes DBRX will accelerate this trend.
Paired with Databricks Mosaic AI’s unified tooling, DBRX helps customers rapidly build and deploy production-quality generative AI applications that are safe, accurate, and governed without giving up control of their data and intellectual property. Customers benefit from built-in data management, governance, lineage, and monitoring capabilities on the Databricks Data Intelligence Platform.
Availability
DBRX is freely available on GitHub and Hugging Face for research and commercial use. Starting today on the Databricks Platform, enterprises can interact with DBRX, leverage its long context abilities in retrieval-augmented generation (RAG) systems, and build custom DBRX models on their own unique data. DBRX is also available on AWS and Google Cloud as well as directly on Microsoft Azure through Azure Databricks.
DBRX is also expected to be available through the NVIDIA API Catalog and supported on the NVIDIA NIM inference microservice.
More information is available here.