Deployment guide
Cheapest way to deploy Devstral-Small-2-24B-Instruct-2512 in 2026
10 providers compared. API token-pricing, dedicated capacity, and rented GPU costs side-by-side, normalized to monthly cost.
Cheapest API
$0.100 / 1M input tokens
at Mistral AI
Cheapest GPU rental
$0.28 / hour
at Verda on V100
Provider rate cards
10 providers compared
| Provider | Hardware | Region | Commitment | Source | |||
|---|---|---|---|---|---|---|---|
| V100 | 2 | 16 | Finland | $0.28 | On-demand | Source ↗ | |
| RTX A6000 | 1 | 48 | Finland | $0.49 | On-demand | Source ↗ | |
| RTX PRO 6000 | 1 | 96 | United States | $0.55 | On-demand | Source ↗ | |
| K80 | 2 | 24 | Multiple regions | $0.79 | On-demand | Source ↗ | |
| Tesla V100 NVLINK | 1 | 32 | United States | $0.80 | On-demand | Source ↗ | |
| RTX 6000 Ada | 1 | 48 | Finland | $0.83 | On-demand | Source ↗ | |
| L40S | 1 | 48 | Finland | $0.91 | On-demand | Source ↗ | |
| V100S | 1 | 32 | France | $1.03 | On-demand | Source ↗ | |
| RTX A6000 | 1 | 48 | United States | $1.09 | On-demand | Source ↗ | |
| RTX A6000 | 1 | 48 | United States | $1.28 | On-demand | Source ↗ | |
| A40 | 1 | 48 | United States | $1.28 | On-demand | Source ↗ | |
| A100 SXM | 1 | 80 | Finland | $1.29 | On-demand | Source ↗ | |
| RTX 5000 | 2 | 16 | France | $1.40 | On-demand | Source ↗ | |
| RTX PRO 6000 | 1 | 96 | Finland | $1.69 | On-demand | Source ↗ | |
| L4 | 2 | 24 | France | $1.76 | On-demand | Source ↗ | |
| V100 | 2 | 16 | France | $1.81 | On-demand | Source ↗ | |
| L40S | 1 | 48 | Netherlands | $1.82 | On-demand | Source ↗ | |
| A100 | 1 | 80 | United States | $1.99 | On-demand | Source ↗ | |
| A100 40GB PCIe | 1 | 40 | United States | $2.06 | On-demand | Source ↗ | |
| A100 40GB NVLINK | 1 | 40 | United States | $2.06 | On-demand | Source ↗ | |
| L40S | 1 | 48 | France | $2.11 | On-demand | Source ↗ | |
| A100 80GB NVLINK | 1 | 80 | United States | $2.21 | On-demand | Source ↗ | |
| A100 80GB PCIe | 1 | 80 | United States | $2.21 | On-demand | Source ↗ | |
| L40S | 1 | 48 | Multiple regions | $2.24 | On-demand | Source ↗ | |
| H100 SXM | 1 | 80 | Finland | $2.29 | On-demand | Source ↗ | |
| GH200 | 1 | 96 | United States | $2.29 | On-demand | Source ↗ | |
| L4 | 2 | 24 | France | $2.34 | On-demand | Source ↗ | |
| A10 | 2 | 24 | France | $2.34 | On-demand | Source ↗ | |
| T4 | 2 | 16 | Multiple regions | $2.74 | On-demand | Source ↗ | |
| A100 SXM | 1 | 80 | United States | $2.79 | On-demand | Source ↗ | |
| H100 SXM | 8 | 80 | Netherlands | $2.95 | On-demand | Source ↗ | |
| H100 | 1 | 80 | United States | $3.29 | On-demand | Source ↗ | |
| H200 SXM | 1 | 141 | Finland | $3.39 | On-demand | Source ↗ | |
| H200 SXM | 8 | 141 | Netherlands | $3.50 | On-demand | Source ↗ | |
| H100 SXM | 1 | 80 | France | $3.50 | On-demand | Source ↗ | |
| A100 SXM | 1 | 80 | France | $3.59 | On-demand | Source ↗ | |
| A100 | 1 | 80 | Multiple regions | $3.67 | On-demand | Source ↗ | |
| H100 SXM | 1 | 80 | United States | $3.99 | On-demand | Source ↗ | |
| H100 SXM | 1 | 80 | United States | $3.99 | On-demand | Source ↗ | |
| H100 | 1 | 80 | United States | $4.25 | On-demand | Source ↗ | |
| T4 | 4 | 16 | Multiple regions | $4.35 | On-demand | Source ↗ | |
| B200 SXM | 1 | 192 | Finland | $4.89 | On-demand | Source ↗ | |
| L4 | 4 | 24 | Multiple regions | $5.41 | On-demand | Source ↗ | |
| H200 SXM | 1 | 141 | United States | $5.49 | On-demand | Source ↗ | |
| B200 SXM | 8 | 192 | Netherlands | $5.50 | On-demand | Source ↗ | |
| A10 | 4 | 24 | Multiple regions | $5.67 | On-demand | Source ↗ | |
| B300 SXM | 8 | 288 | Netherlands | $6.10 | On-demand | Source ↗ | |
| V100 | 2 | 16 | Multiple regions | $6.12 | On-demand | Source ↗ | |
| GH200 | 1 | 96 | United States | $6.50 | On-demand | Source ↗ | |
| B200 SXM | 1 | 192 | United States | $6.69 | On-demand | Source ↗ | |
| H100 SXM | 1 | 80 | Multiple regions | $6.88 | On-demand | Source ↗ | |
| H100 | 1 | 80 | Multiple regions | $6.98 | On-demand | Source ↗ | |
| B300 SXM | 1 | 288 | Finland | $6.99 | On-demand | Source ↗ | |
| B200 SXM | 1 | 192 | United States | $9.95 | On-demand | Source ↗ | |
| L40 | 8 | 48 | United States | $10.00 | On-demand | Source ↗ | |
| L40S | 8 | 48 | United States | $18.00 | On-demand | Source ↗ | |
| RTX PRO 6000 | 8 | 96 | United States | $20.00 | On-demand | Source ↗ | |
| A100 | 8 | 80 | United States | $21.60 | On-demand | Source ↗ | |
| A100 SXM | 8 | 80 | Multiple regions | $23.72 | On-demand | Source ↗ | |
| A100 SXM | 8 | 80 | Multiple regions | $27.20 | On-demand | Source ↗ | |
| GB200 | 4 | 192 | United States | $42.00 | On-demand | Source ↗ | |
| H100 SXM | 8 | 80 | United States | $49.24 | On-demand | Source ↗ | |
| H200 SXM | 8 | 141 | United States | $50.44 | On-demand | Source ↗ | |
| MI300X | 8 | 192 | Multiple regions | $57.60 | On-demand | Source ↗ | |
| H200 SXM | 8 | 141 | Multiple regions | $63.30 | On-demand | Source ↗ | |
| B200 SXM | 8 | 192 | United States | $68.80 | On-demand | Source ↗ | |
| H200 SXM | 8 | 141 | Multiple regions | $84.80 | On-demand | Source ↗ | |
| H100 SXM | 8 | 80 | Multiple regions | $88.49 | On-demand | Source ↗ | |
| GB200 | 2 | 192 | Multiple regions | $108.16 | On-demand | Source ↗ |
Break-even chart
API vs. GPU rental
The crossover point at which renting a GPU full-time becomes cheaper than paying per token: ~34M tokens/day.
Your monthly cost
Top 5 cheapest for your workload
Adjust the assumptions below — token volume, input/output ratio, days and hours of usage — to see how the cheapest options shift.
| Rank | Provider | Pricing | Hardware | Monthly |
|---|---|---|---|---|
| #1 | GPU · On-demand | V100 | $202 | |
| #2 | GPU · On-demand | RTX A6000 | $353 | |
| #3 | API | — | $390 | |
| #4 | GPU · On-demand | RTX PRO 6000 | $396 | |
| #5 | GPU · On-demand | K80 | $570 |
Spec sheet
Devstral-Small-2-24B-Instruct-2512 at a glance
- VRAM (native precision)
- 25 GB
- Parameters
- 24.0114B
- Native precision
- fp8
- Context length
- —
- License
- apache-2.0
- Knowledge cutoff
- —
- Modalities
- —
- Access type
- Open source
- EU developed
- Yes
- Origin country
- FR
Why these numbers
A second opinion on the data
Hardware footprint
Devstral-Small-2-24B-Instruct-2512 is a 24.0114B-parameter model that needs 25 GB VRAM at fp8 when self-hosted at native precision (fits a single A100-40GB or L40S). Quantization to int8 typically halves the VRAM requirement; int4 quarters it, at modest accuracy cost. 9 GPU rental providers in nfer's index currently offer hardware that fits this model at native precision.
Cheapest path today
For Devstral-Small-2-24B-Instruct-2512: The cheapest API offering is Mistral AI at $0.10/1M input + $0.30/1M output tokens. The cheapest GPU rental that fits the model is Verda on V100 at $0.28/hour. The break-even point between paying per token and renting a GPU depends on your daily volume — see the chart above.
Licensing and fit
Released under the apache-2.0 license, Devstral-Small-2-24B-Instruct-2512 ships with a context length not specified; open-source weights are publicly available. European model — relevant for EU-sovereignty filtering.
FAQ
Common questions
What's the cheapest way to host Devstral-Small-2-24B-Instruct-2512?
The cheapest API option for Devstral-Small-2-24B-Instruct-2512 in nfer's index is Mistral AI at $0.100/1M input + $0.300/1M output tokens. For self-hosted workloads, the cheapest GPU rental that fits is Verda on V100 at $0.28/hour. The right choice depends on your daily token volume — see the break-even chart on this page.How much VRAM does Devstral-Small-2-24B-Instruct-2512 need?
Devstral-Small-2-24B-Instruct-2512 25 GB at native precision; roughly 13 GB at int8 and 6 GB at int4. Native precision is fp8. Quantization roughly halves (int8) or quarters (int4) the VRAM footprint at modest accuracy cost.Can I use Devstral-Small-2-24B-Instruct-2512 commercially?
Yes — released under the apache-2.0 license, which permits commercial use.What's the difference between API and GPU rental for Devstral-Small-2-24B-Instruct-2512?
Token-priced API providers (like Mistral AI) bill per million input/output tokens — best for low or bursty volume. Renting a GPU (e.g. Verda at $0.28/hour) is a flat ~$201.60/month regardless of usage — better economics once you sustain enough tokens per day to justify the fixed cost. The break-even chart on this page shows the exact crossover point.Is Devstral-Small-2-24B-Instruct-2512 available with EU data residency?
Devstral-Small-2-24B-Instruct-2512 is a European model (origin: FR). 4 EU-owned providers offer hosting in nfer's index — filter on EU sovereignty in the comparator to see them.
Prices last updated · 2026-04-30