genai / news / / India TV News
N Nvidia has rolled out Nemotron 3 Super, an open-source AI model.
Nemotron 3 Super uses a hybrid mixture-of-experts architecture with only 12 billion of its 120 billion parameters active at once.
KEY POINTS
- The model features a massive context window of 1 million tokens, enabling sustained multi-step reasoning.
- Latent MoE technology allows it to leverage four expert modules simultaneously when generating tokens, boosting efficiency.
- Nemotron 3 Super was trained entirely on synthetic data from high-performing reasoning models, totaling over 10 trillion tokens.
- Nvidia has released detailed technical documentation for training, reinforcement learning, and evaluation alongside open model weights.
COMPANIES
Summarized by Newsio from India TV News. How we summarize →