LogoFastRouter
Meta logo

LLaMA 3.1 8B Instant

MetaReleased Feb 12, 2025meta-llama/llama-3.1-8b-instant
Compare

Llama 3.1 8B Instruct is Meta's compact, efficiency-focused language model from the Llama 3.1 family. At just 8 billion parameters, this instruction-tuned variant delivers impressive performance with minimal computational requirements, making it ideal for resource-constrained environments and latency-sensitive applications. Despite its smaller size, the model maintains competitive performance in human evaluations against much larger models, particularly excelling in straightforward dialogue, content generation, and common instruction-following tasks. The model features improved inference speed and reduced deployment costs compared to larger variants while maintaining the core capabilities that make Llama models effective. It's particularly well-suited for mobile applications, edge devices, and scaled deployments where efficiency and performance balance are critical considerations.

Context
8K
Max output
131K
Input /1M
$0.05
Output /1M
$0.08
Blended /1M
$0.06
AcceptsTextProducesTextTokenizer LLaMA3Instruct type instruct

Providers

FastRouter routes your requests to this provider. You can also bring your own key.

Amazon Bedrock logo
Amazon Bedrock
amazonbedrock
Input /1M$0.22
Output /1M$0.22
Context8K
Max output131K
Latency—
Throughput—
Supports tool calling

Supported parameters

Request parameters you can send with this model.

Core (Sampling & basic generation)

max_tokens
Maximum tokens to generate.
stop
Sequences where generation stops.
temperature
Controls randomness of output.
top_p
Nucleus sampling threshold.

Tool Use (Function Calls & Tools)

tool_choice
How the model should use tools.
tools
Tool/function definitions available to the model.

Request Behaviour (Request Config)

stream
Stream partial responses as they are generated.

Performance

Median throughput and time to first token per provider over the last week.

Throughput

Latency

Make your first API call

OpenAI-compatible. Point your SDK at FastRouter, or call the API directly.

Full API docs
Replace <FASTROUTER_API_KEY> with your key · Get your key →Install
OpenAI SDKHTTP
from openai import OpenAI
client = OpenAI(
base_url="https://api.fastrouter.ai/api/v1", # FastRouter base URL
api_key= "<FASTROUTER_API_KEY>", # Replace with your FastRouter API key
)
completion = client.chat.completions.create(
model="meta-llama/llama-3.1-8b-instant", # Replace with your model ID
messages=[
{ "role": "user", "content": "What is the meaning of life?" }
]
)
print(completion.choices[0].message.content)

Frequently asked questions

More models from Meta

Meta logo
LLaMA 4 Scout 17B 16E Instructmeta-llama/llama-4-scout-17b-16e-instruct

Llama-4-Scout-17B-16E-Instruct is a multimodal, instruction-tuned language model developed by Meta, designed to handle long-context tasks efficiently. It features 17 billion active parameters with a total of 109 billion parameters across 16 experts, utilizing a mixture-of-experts (MoE) architecture. The model supports a context window of up to 10 million tokens, making it suitable for applications requiring extensive context, such as multi-document summarization and large codebase exploration.

Meta logo
Muse Spark 1.1meta/muse-spark-1.1

Muse Spark 1.1 is Meta's first paid agentic reasoning model, accepting text, image, video, and PDF input and returning text, with a 1,048,576-token context window and 131,072 max output tokens. It thinks before it answers with reasoning tokens billed as output, actively manages and compacts its own context on long-running workflows, and exposes native tool calling, structured output, parallel tool calling, and built-in web search grounding with inline citations via the Responses API.

Meta logo
Muse Spark 1.2meta/muse-spark-1.2

Muse Spark 1.2 is Meta's reasoning model for complex agentic tasks, accepting text, images, video, audio, and PDF documents and returning text, with a 1,048,576-token context window. Called via the Responses API, it supports cross-turn reasoning replay, tool-calling loops, built-in web search grounding, and file inputs, with configurable reasoning effort and structured JSON output. Meta reports strong results on multi-file refactors, extended debugging sessions, and whole-repository generation.

Model scores sourced from ArtificialAnalysis