Meta logo

Llama 3.3 70B Instruct Turbo

MetaReleased Dec 6, 2024meta-llama/llama-3.3-70b-instruct-turbo
CostCompare

Llama 3.3 70B Turbo is an FP8-quantized version of Llama 3.3 70B for significantly faster inference with a minor accuracy trade-off.

Context
131K
Max output
16K
Input /1M
$0.10
Output /1M
$0.32
Blended /1M
$0.15
AcceptsTextProducesTextTokenizer Llama

Providers

FastRouter routes your requests to this provider. You can also bring your own key.

Pricing tier
DeepInfra logo
DeepInfrafp8
deepinfra
Input /1M$0.10
Output /1M$0.32
Context131K
Max output16K
Latency—
Throughput—
Supports tool callingSupports structured (JSON) output

Supported parameters

Request parameters you can send with this model.

Core (Sampling & basic generation)

max_tokens
Maximum tokens to generate.
min_p
Minimum probability threshold for sampling.
seed
Seed for deterministic sampling.
stop
Sequences where generation stops.
temperature
Controls randomness of output.
top_k
Limits sampling to top K tokens.
top_p
Nucleus sampling threshold.

Penalties (Token Penalties)

frequency_penalty
Penalizes frequent tokens.
presence_penalty
Penalizes tokens already present.
repetition_penalty
Penalizes repeated tokens.

Tool Use (Function Calls & Tools)

tool_choice
How the model should use tools.
tools
Tool/function definitions available to the model.

Output & Format (Response Formatting)

logprobs
Return log probabilities of output tokens.
response_format
Structured output format configuration.
structured_outputs
Enforce a structured output schema.

Performance

Median throughput and time to first token per provider over the last week.

Throughput

Latency

Make your first API call

OpenAI-compatible. Point your SDK at FastRouter, or call the API directly.

Full API docs
Replace <FASTROUTER_API_KEY> with your key · Get your key →Install
OpenAI SDKHTTP
from openai import OpenAI
client = OpenAI(
base_url="https://api.fastrouter.ai/api/v1", # FastRouter base URL
api_key= "<FASTROUTER_API_KEY>", # Replace with your FastRouter API key
)
completion = client.chat.completions.create(
model="meta-llama/llama-3.3-70b-instruct-turbo", # Replace with your model ID
messages=[
{ "role": "user", "content": "What is the meaning of life?" }
]
)
print(completion.choices[0].message.content)

Frequently asked questions

More models from Meta

Meta logo
LLaMA 3.1 8B Instantmeta-llama/llama-3.1-8b-instant

Llama 3.1 8B Instruct is Meta's compact, efficiency-focused language model from the Llama 3.1 family. At just 8 billion parameters, this instruction-tuned variant delivers impressive performance with minimal computational requirements, making it ideal for resource-constrained environments and latency-sensitive applications. Despite its smaller size, the model maintains competitive performance in human evaluations against much larger models, particularly excelling in straightforward dialogue, content generation, and common instruction-following tasks. The model features improved inference speed and reduced deployment costs compared to larger variants while maintaining the core capabilities that make Llama models effective. It's particularly well-suited for mobile applications, edge devices, and scaled deployments where efficiency and performance balance are critical considerations.

Meta logo
LLaMA 4 Scout 17B 16E Instructmeta-llama/llama-4-scout-17b-16e-instruct

Llama-4-Scout-17B-16E-Instruct is a multimodal, instruction-tuned language model developed by Meta, designed to handle long-context tasks efficiently. It features 17 billion active parameters with a total of 109 billion parameters across 16 experts, utilizing a mixture-of-experts (MoE) architecture. The model supports a context window of up to 10 million tokens, making it suitable for applications requiring extensive context, such as multi-document summarization and large codebase exploration.

Meta logo
Llama Guard 4 12Bmeta-llama/llama-guard-4-12b

Llama Guard 4 is a natively multimodal 12B safety classifier for classifying prompts and responses as safe or unsafe.

Meta logo
Muse Glimmer 30Bmeta/muse-glimmer-30b

Muse Glimmer is a 30B multimodal agentic model distilled from Muse Spark, combining reasoning, tool use and failure recovery in a model that runs locally on consumer hardware.

Meta logo
Muse Spark 1.1meta/muse-spark-1.1

Muse Spark 1.1 is Meta's first paid agentic reasoning model, accepting text, image, video, and PDF input and returning text, with a 1,048,576-token context window and 131,072 max output tokens. It thinks before it answers with reasoning tokens billed as output, actively manages and compacts its own context on long-running workflows, and exposes native tool calling, structured output, parallel tool calling, and built-in web search grounding with inline citations via the Responses API.

Meta logo
Muse Spark 1.2meta/muse-spark-1.2

Muse Spark 1.2 is Meta's reasoning model for complex agentic tasks, accepting text, images, video, audio, and PDF documents and returning text, with a 1,048,576-token context window. Called via the Responses API, it supports cross-turn reasoning replay, tool-calling loops, built-in web search grounding, and file inputs, with configurable reasoning effort and structured JSON output. Meta reports strong results on multi-file refactors, extended debugging sessions, and whole-repository generation.

Model scores sourced from ArtificialAnalysis