Llama-3.1-8B-Instruct
meta · meta/llama-3.1-8b-instruct
Compact open Llama model for lightweight chat, drafting, and self-hosting
≈85k Chinese characters of context · Calls tools / agents · Structured JSON output · Open weights, self-hostable
Read a 200,000-Chinese-character book and write a 2,000-Chinese-character summary: about No public rate
An order-of-magnitude estimate at 1.5 tokens per Chinese character and the vendor's own rate — not a quote. Full method: the glossary on the AI Models page.
Specs
| Context | 128,000(≈85k Chinese characters) |
|---|---|
| Max output | 4,096 |
| Structured output | Yes |
| Open weights | Yes |
| Released | 2024-07-23 |
Source: models.dev snapshot 2026-08-29
Who serves it, at what price
| Provider | In /M | Out /M | Cache read /M |
|---|---|---|---|
| Cortecs | $0.167 | $0.167 | — |
| Helicone | $0.02 | $0.049999999999999996 | — |
Rows tagged “first-party” are the model vendor's own pricing; untagged rows are resale channels and may differ.
When to choose it
We have not assessed this model. It comes from the full models.dev snapshot — the specs are the vendor's published figures, and a price is the vendor's own only on rows tagged first-party; the rest are resale channels. The fit is simply not something anyone here has written.
Leaderboard
Not yet on any leaderboard we track. That does not mean the model performs poorly — it means we have not taken this snapshot for it yet, and we do not publish a score we have not measured.