LLM Reference
NVIDIA NIM

NVIDIA NIM

NVIDIA

HighlightHyperscaler

Platform

NVIDIA's AI platform offers a comprehensive ecosystem for developing, deploying, and scaling AI applications across industries. At its core, the platform leverages GPU-accelerated computing to enhance deep learning and machine learning workloads. It includes NVIDIA AI Enterprise, providing cloud-native tools for data science and generative AI, and NVIDIA NIM (Inference Microservices) for rapid deployment of production AI models. The platform supports various AI frameworks and libraries, ensuring optimized performance for diverse AI workloads and reducing application launch times from weeks to minutes. The platform's infrastructure seamlessly integrates on-premises and cloud environments, featuring NVIDIA DGX and HGX platforms for high-performance computing and AI tasks. This robust infrastructure is designed with energy efficiency in mind, allowing for innovation without excessive operational costs. The AI Accelerated program showcases validated applications that utilize this powerful infrastructure, enabling organizations to fast-track their AI initiatives while maintaining security and scalability across operations. This comprehensive approach allows customers to efficiently manage complex AI workflows and accelerate their AI-driven projects.

About NVIDIA

NVIDIA is a pioneer in accelerated computing and has evolved into a full-stack computing company with a strong focus on AI technologies. Their AI platform encompasses: 1. GPU-accelerated computing: NVIDIA's GPUs power AI and deep learning applications, providing the computational backbone for modern AI systems. 2. AI software ecosystem: NVIDIA offers a comprehensive suite of AI software tools, libraries, and frameworks to support developers and researchers in building and deploying AI solutions. 3. Data center solutions: The company provides data-center-scale offerings that are reshaping industries through AI-driven innovations. 4. Domain-specific AI applications: NVIDIA develops AI technologies for various fields, including robotics, self-driving cars, healthcare, and computer graphics. 5. AI research: The company is at the forefront of AI research, continuously pushing the boundaries of artificial intelligence and machine learning. 6. AI-driven metaverse: NVIDIA is leveraging its AI expertise to fuel the creation of the metaverse, combining graphics and AI technologies. 7. Enterprise AI: NVIDIA's platform supports businesses in implementing AI solutions across various sectors, from manufacturing to finance. NVIDIA's AI platform is designed to provide end-to-end solutions for AI development, training, and deployment, making it a cornerstone of the modern AI ecosystem.

Available Models(51)

ModelInput (per 1M)Output (per 1M)Type
Llama 3 70B InstructProvisioned
Mistral LargeProvisioned
Gemma 7B InstructProvisioned
Mixtral 8x7BProvisioned
Mixtral 8x22B v0.1Provisioned
Phi-3 Mini 128KProvisioned
ArcticProvisioned
Nemotron 4 340BProvisioned
Mistral 7B v0.1Provisioned
Yi LargeProvisioned
Codestral 22BProvisioned
SOLAR 10.7BProvisioned
PaliGemma 3B 896Provisioned
Llama 3 8B InstructProvisioned
DBRX InstructProvisioned
RecurrentGemma 2BProvisioned
SEA-LION 7BProvisioned
Gemma 2B InstructProvisioned
CodeGemma 7B InstructProvisioned
CodeGemma 1.1 7BProvisioned
Granite 34B CodeProvisioned
Granite 8B CodeProvisioned
Breeze 7BProvisioned
CodeLlama 70BProvisioned
Llama 2 70B ChatProvisioned
Phi-3 Medium 4KProvisioned
Phi-3 Mini 4kProvisioned
Phi-3 Small 128KProvisioned
Phi-3 Small 8KProvisioned
SeaLLM 7B V2.5Provisioned
Fuyu-8BProvisioned
Phi-3 VisionProvisioned
Kosmos 2Provisioned
NeVA 22BProvisioned
LLaVA 1.6 Hermes Yi 34BProvisioned
Llama 3.1 8B InstructProvisioned
Llama 3.1 70B InstructProvisioned
Llama 3.1 405B InstructProvisioned
Mistral NeMo Instruct (2407)Provisioned
NVIDIA Llama 3 ChatQA 70BProvisioned
NVIDIA Llama 3 ChatQA 8BProvisioned
StarCoder2 7BProvisioned
StarCoder2 15BProvisioned
Phi-3 Medium 128KProvisioned
Baichuan 2 13B ChatProvisioned
ChatGLM3 6BProvisioned
DeepSeek Coder 6.7BProvisioned
DePlotProvisioned
Gemma 2 27B InstructProvisioned
Gemma 2 9B InstructProvisioned
LLaVA 1.6 Mistral 7BProvisioned

Company Info

Founded1993
Santa Clara, California, United States