Nemotron
Nemotron is NVIDIA's family of open large language models, optimized and distilled for efficient inference on NVIDIA GPUs, spanning general-purpose, reasoning-focused, and domain-specific variants used both directly and as a base for customization.
3 resources across 1 library
Glossary Terms(3)
Nemotron
Nemotron is NVIDIA's family of open large language models, optimized and distilled for efficient inference on NVIDIA GPUs, spanning general-purpose, reasoning-…
Mixture of Experts
Mixture of Experts (MoE) is a neural network architecture that replaces a single dense feed-forward layer with many smaller "expert" sub-networks and a learned…
Knowledge Distillation
Knowledge distillation is a machine learning technique for training a smaller "student" model to reproduce the behavior of a larger, more capable "teacher" mod…