State Space Model
A State Space Model (SSM), in the context of modern sequence modeling, is a neural architecture — with Mamba as a prominent example — that processes sequences using a continuous-time-inspired recurrent state, offering linear-time scaling with sequence length as an alternative to the quadratic-cost self-attention used…
3 resources across 1 library
Glossary Terms(3)
Jamba (AI21)
Jamba is a family of large language models from AI21 Labs that combines the Transformer architecture with a state-space model (Mamba) architecture in a hybrid…
State Space Model (Mamba)
A State Space Model (SSM), in the context of modern sequence modeling, is a neural architecture — with Mamba as a prominent example — that processes sequences…
Jurassic (AI21)
Jurassic is a family of large language models developed by AI21 Labs, an Israeli AI company, with Jurassic-1 released in 2021 and Jurassic-2 following in 2023,…