Deployment guide

Cheapest way to deploy NVIDIA-Nemotron-3-Super-120B-A12B-BF16 in 2026

7 providers compared. API token-pricing, dedicated capacity, and rented GPU costs side-by-side, normalized to monthly cost.

Cheapest API

$0.150 / 1M input tokens

at AWS

Cheapest GPU rental

$1.24 / hour

at Azure on RTX PRO 6000

7 providers compared

ProviderRegionQuantizationSource
AWS
Multiple regions$0.150$0.650Source ↗
Baseten
United States$0.300$0.750Source ↗

API vs. GPU rental

The crossover point at which renting a GPU full-time becomes cheaper than paying per token: ~75M tokens/day.

Monthly cost vs. daily token volume — AWS API vs. Azure GPU rental for NVIDIA-Nemotron-3-Super-120B-A12B-BF16API cost (blue line) scales linearly with token volume; GPU rental (green line) is a flat ~$895 per month. They cross at roughly 75M tokens/day, the break-even point.$0$4.0k$8.0k$12k10k100k1M10M100M1BBreak-even · 75M/dayAPI (AWS)GPU (Azure)Tokens per day (log scale)Monthly cost (USD)

Top 5 cheapest for your workload

Adjust the assumptions below — token volume, input/output ratio, days and hours of usage — to see how the cheapest options shift.

Your workload

Tokens vol.
1M1B
Input / Output
100% Input100% Output
Active days / mo
1 day30 days
Active hours / day
1 hr24 hrs
Cache hit rate
0%100%
Batch APIs
RankProviderPricingHardwareMonthly
#1
AWS
API$825
#2
Azure
GPU · On-demandRTX PRO 6000$895
#3
Baseten
API$990
#4
Nebius
GPU · On-demandH100 SXM$2.12k
#5
Nebius
GPU · On-demandH200 SXM$2.52k

View full results with your assumptions →

NVIDIA-Nemotron-3-Super-120B-A12B-BF16 at a glance

VRAM (native precision)
248 GB
Parameters
123.611B
Native precision
bf16
Context length
License
other
Knowledge cutoff
Modalities
text
Access type
Open source
EU developed
No
Origin country
US

A second opinion on the data

Hardware footprint

NVIDIA-Nemotron-3-Super-120B-A12B-BF16 is a 123.611B-parameter model that needs 248 GB VRAM at bf16 when self-hosted at native precision (needs 4x H100). Quantization to int8 typically halves the VRAM requirement; int4 quarters it, at modest accuracy cost. 6 GPU rental providers in nfer's index currently offer hardware that fits this model at native precision.

Cheapest path today

For NVIDIA-Nemotron-3-Super-120B-A12B-BF16: The cheapest API offering is AWS at $0.15/1M input + $0.65/1M output tokens. The cheapest GPU rental that fits the model is Azure on RTX PRO 6000 at $1.24/hour. The break-even point between paying per token and renting a GPU depends on your daily volume — see the chart above.

Licensing and fit

Released under the other license, NVIDIA-Nemotron-3-Super-120B-A12B-BF16 ships with a context length not specified; open-source weights are publicly available.

Common questions

  • What's the cheapest way to host NVIDIA-Nemotron-3-Super-120B-A12B-BF16?
    The cheapest API option for NVIDIA-Nemotron-3-Super-120B-A12B-BF16 in nfer's index is AWS at $0.150/1M input + $0.650/1M output tokens. For self-hosted workloads, the cheapest GPU rental that fits is Azure on RTX PRO 6000 at $1.24/hour. The right choice depends on your daily token volume — see the break-even chart on this page.
  • How much VRAM does NVIDIA-Nemotron-3-Super-120B-A12B-BF16 need?
    NVIDIA-Nemotron-3-Super-120B-A12B-BF16 248 GB at native precision; roughly 124 GB at int8 and 62 GB at int4. Native precision is bf16. Quantization roughly halves (int8) or quarters (int4) the VRAM footprint at modest accuracy cost.
  • Can I use NVIDIA-Nemotron-3-Super-120B-A12B-BF16 commercially?
    Released under other. Most permissive open-source licenses allow commercial use; confirm specific clauses with the publisher before deploying.
  • What's the difference between API and GPU rental for NVIDIA-Nemotron-3-Super-120B-A12B-BF16?
    Token-priced API providers (like AWS) bill per million input/output tokens — best for low or bursty volume. Renting a GPU (e.g. Azure at $1.24/hour) is a flat ~$894.96/month regardless of usage — better economics once you sustain enough tokens per day to justify the fixed cost. The break-even chart on this page shows the exact crossover point.
  • Is NVIDIA-Nemotron-3-Super-120B-A12B-BF16 available with EU data residency?
    NVIDIA-Nemotron-3-Super-120B-A12B-BF16 is not a European-developed model. 2 EU-owned providers offer hosting in nfer's index — filter on EU sovereignty in the comparator to see them.

Prices last updated · 2026-04-30