ModelPickr

Models / Meta / Llama-3.1-8B-Instruct

Meta · llama

Llama-3.1-8B-Instruct

Compact open Llama model for lightweight chat, drafting, and self-hosting

$0.06 in · $0.06 out

per 1M tokens · provider rate closest to the median. No first-party Meta price was listed. The reference price is Hugging Face's rate, the provider closest to the median.

Provider input prices run from $0.02 to $0.22 per 1M tokens. Output prices run from $0.04 to $0.29.

Context
128,000
Max output
4,096
Cache read
—
Cache write
—
Reasoning
No
Tool calls
Yes
Structured output
Unknown
Vision
No
Open weights
Yes
License
—
Released
Jul 23, 2024
Updated in source
Jul 23, 2024
Knowledge
2023-12
Providers
10

Hugging Face weights

What this model costs per month

Prices are USD per 1M tokens. A month is 30 days. Cache hits use the cache-read rate when the model has one; otherwise the cache field is ignored.

Estimated monthly cost

Llama-3.1-8B-Instruct

$0.45

Cache hit is ignored because this model has no cache-read price.

monthly = requests/day × 30 × (input tokens × (1 − cache hit) × input price + input tokens × cache hit × cache-read price + output tokens × output price) ÷ 1,000,000

Providers

Base rates from Models.dev. Where a provider lists the model more than once, the row is the listing whose id is closest to the canonical model id.
ProviderInputOutputCache readCache writeStatus
Kilo Gateway$0.02$0.04———
Novita AI$0.02$0.05———
OpenRouter$0.05$0.08$0.025——
NanoGPT$0.054$0.085$0.027——
Hugging Facereference$0.06$0.06———
Cloudflare Workers AI$0.15$0.29———
Cortecs$0.17$0.17———
Amazon Bedrock$0.22$0.22———
CoreWeave$0.22$0.22$0.22——
Merge Gateway$0.22$0.22———

Jobs this model qualifies for