Hacker News·2 min read·hard

Nvidia Nemotron 3.5 Lightning

B
beklein
Nvidia Nemotron 3.5 Lightning
AI Summary

Nvidia has released the Nemotron 3.5 Lightning, a 30B parameter conversational AI model optimized for high-speed text generation. The model is available for developers via platforms like Hugging Face and supports integration with tools like vLLM and Transformers.

like 9 Follow NVIDIA 65.2k Text Generation Transformers Safetensors PyTorch 6 languages nemotron_h nvidia nemotron-3.5 conversational 8-bit precision modelopt License: openmdw-1.1 Model card Files Files and versions xet Community 2 Deploy Copy to bucket new Use this model Instructions to use nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started. Libraries Transformers How to use nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 with Transformers:

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologyai

Get the full story

Sign up for Headlinne to unlock AI insights, political bias analysis, and your personalized news feed.

Create free account

Already have an account? Sign in