DBRX

DBRX is an open-weight large language model released by Databricks (developed by its Mosaic AI research team) in March 2024, built as a fine-grained mixture-of-experts transformer with 132 billion total parameters and about 36 billion active per token, trained entirely on Databricks' own data and compute platform.

1 resource across 1 library