Meta logo

LLaMA 4 Scout 17B 16E Instruct

MetaReleased Feb 12, 2025meta-llama/llama-4-scout-17b-16e-instruct
Compare

Llama-4-Scout-17B-16E-Instruct is a multimodal, instruction-tuned language model developed by Meta, designed to handle long-context tasks efficiently. It features 17 billion active parameters with a total of 109 billion parameters across 16 experts, utilizing a mixture-of-experts (MoE) architecture. The model supports a context window of up to 10 million tokens, making it suitable for applications requiring extensive context, such as multi-document summarization and large codebase exploration.

Context
33K
Max output
8K
Input /1M
$0.11
Output /1M
$0.34
Blended /1M
$0.17
AcceptsTextProducesTextTokenizer LLaMA4Instruct type instruct

Providers

FastRouter routes your requests to this provider. You can also bring your own key.

Pricing tier
Amazon Bedrock logo
Amazon Bedrock
amazonbedrock
Input /1M$0.17
Output /1M$0.66
Context33K
Max output8K
Latency—
Throughput—
Supports tool callingSupports structured (JSON) output

Supported parameters

Request parameters you can send with this model.

Core (Sampling & basic generation)

max_tokens
Maximum tokens to generate.
seed
Seed for deterministic sampling.
stop
Sequences where generation stops.
temperature
Controls randomness of output.
top_p
Nucleus sampling threshold.

Penalties (Token Penalties)

frequency_penalty
Penalizes frequent tokens.
presence_penalty
Penalizes tokens already present.

Tool Use (Function Calls & Tools)

tool_choice
How the model should use tools.
tools
Tool/function definitions available to the model.

Output & Format (Response Formatting)

logit_bias
Bias values for specific token IDs.
response_format
Structured output format configuration.

Performance

Median throughput and time to first token per provider over the last week.

Throughput

Latency

Make your first API call

OpenAI-compatible. Point your SDK at FastRouter, or call the API directly.

Full API docs
Replace <FASTROUTER_API_KEY> with your key · Get your key →Install
OpenAI SDKHTTP
from openai import OpenAI
client = OpenAI(
base_url="https://api.fastrouter.ai/api/v1", # FastRouter base URL
api_key= "<FASTROUTER_API_KEY>", # Replace with your FastRouter API key
)
completion = client.chat.completions.create(
model="meta-llama/llama-4-scout-17b-16e-instruct", # Replace with your model ID
messages=[
{ "role": "user", "content": "What is the meaning of life?" }
]
)
print(completion.choices[0].message.content)

Frequently asked questions

More models from Meta

Meta logo
LLaMA 3.1 8B Instantmeta-llama/llama-3.1-8b-instant

Llama 3.1 8B Instruct is Meta's compact, efficiency-focused language model from the Llama 3.1 family. At just 8 billion parameters, this instruction-tuned variant delivers impressive performance with minimal computational requirements, making it ideal for resource-constrained environments and latency-sensitive applications. Despite its smaller size, the model maintains competitive performance in human evaluations against much larger models, particularly excelling in straightforward dialogue, content generation, and common instruction-following tasks. The model features improved inference speed and reduced deployment costs compared to larger variants while maintaining the core capabilities that make Llama models effective. It's particularly well-suited for mobile applications, edge devices, and scaled deployments where efficiency and performance balance are critical considerations.

Meta logo
Muse Spark 1.1meta/muse-spark-1.1

Muse Spark 1.1 is Meta's first paid agentic reasoning model, accepting text, image, video, and PDF input and returning text, with a 1,048,576-token context window and 131,072 max output tokens. It thinks before it answers with reasoning tokens billed as output, actively manages and compacts its own context on long-running workflows, and exposes native tool calling, structured output, parallel tool calling, and built-in web search grounding with inline citations via the Responses API.

Meta logo
Muse Spark 1.2meta/muse-spark-1.2

Muse Spark 1.2 is Meta's reasoning model for complex agentic tasks, accepting text, images, video, audio, and PDF documents and returning text, with a 1,048,576-token context window. Called via the Responses API, it supports cross-turn reasoning replay, tool-calling loops, built-in web search grounding, and file inputs, with configurable reasoning effort and structured JSON output. Meta reports strong results on multi-file refactors, extended debugging sessions, and whole-repository generation.

Model scores sourced from ArtificialAnalysis