L3 8B Lunaris v1 Turbo
sao10k/l3-8b-lunaris-v1-turboL3 8B Lunaris v1 Turbo is a Llama 3 8B fine-tune from Sao10K, served in a fast FP8 configuration.
SA
L3.1 70B Euryale v2.2
Euryale 3.1 70B v2.2 is a model focused on creative roleplay from Sao10k.
Context
131K
Max output
131K
Input /1M
$0.85
Output /1M
$0.85
Blended /1M
$0.85
AcceptsTextProducesTextTokenizer Llama
Providers
FastRouter routes your requests to this provider. You can also bring your own key.
Pricing tier
ProviderInput /1MOutput /1MContextMax outputLatencyThroughputFeaturesDetails
DeepInfrafp8
deepinfraInput /1M$0.85
Output /1M$0.85
Context131K
Max output131K
Latency—
Throughput—
Supports structured (JSON) output
Supported parameters
Request parameters you can send with this model.
Core (Sampling & basic generation)
- max_tokens
- Maximum tokens to generate.
- min_p
- Minimum probability threshold for sampling.
- seed
- Seed for deterministic sampling.
- stop
- Sequences where generation stops.
- temperature
- Controls randomness of output.
- top_k
- Limits sampling to top K tokens.
- top_p
- Nucleus sampling threshold.
Penalties (Token Penalties)
- frequency_penalty
- Penalizes frequent tokens.
- presence_penalty
- Penalizes tokens already present.
- repetition_penalty
- Penalizes repeated tokens.
Output & Format (Response Formatting)
- logprobs
- Return log probabilities of output tokens.
- response_format
- Structured output format configuration.
- structured_outputs
- Enforce a structured output schema.
- top_logprobs
- Number of top log probabilities to return.
Performance
Median throughput and time to first token per provider over the last week.
Throughput
Latency
Make your first API call
OpenAI-compatible. Point your SDK at FastRouter, or call the API directly.
Replace
<FASTROUTER_API_KEY> with your key · Get your key →Installfrom openai import OpenAI
client = OpenAI(
base_url="https://api.fastrouter.ai/api/v1", # FastRouter base URL
api_key= "<FASTROUTER_API_KEY>", # Replace with your FastRouter API key
)
completion = client.chat.completions.create(
model="sao10k/l3.1-70b-euryale-v2.2", # Replace with your model ID
messages=[
{ "role": "user", "content": "What is the meaning of life?" }
]
)
print(completion.choices[0].message.content)
Frequently asked questions
More models from Sao10K
Model scores sourced from ArtificialAnalysis