Skip to content
AnyRouter

Llama 3.1 8B Instruct

Tools
meta/llama-3.1-8b-instruct

131K context · Jul 2024 · 5 upstreams

Meta's compact Llama 3.1 8B instruction-tuned model optimized for fast inference and edge deployments.

Bring your own keyAnyRouter has no platform route for Llama 3.1 8B Instruct. Requests use your key and bill your provider account. AnyRouter adds no fee.
context
131K
input / 1M (list)
$0.02
output / 1M (list)
$0.04
routes
5
speed, 24h
—

Upstreams

5
  1. 1Hugging FaceYour key · not addedyour planTPS —TTFT ——
  2. 2OpenRouterYour key · not addedyour planTPS —TTFT ——
  3. 3Vercel AI GatewayYour key · not addedyour planTPS —TTFT ——
  4. 4NovitaAIYour key · not addedyour planTPS —TTFT ——
  5. 5Nous ResearchYour key · not addedyour planTPS —TTFT ——
  • Up
  • No traffic
  • Down

Try it

Send a prompt

Details

Owner
Meta
Kind
Chat
Released
Jul 2024
Context
131K
Data policy
Provider retention
Endpoint
/api/v1/chat/completions

Quick start

curl https://anyrouter.dev/api/v1/chat/completions \
  -H "Authorization: Bearer $ANYROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "meta/llama-3.1-8b-instruct",
  "messages": [
    {
      "role": "user",
      "content": "Say hi in 3 words."
    }
  ]
}'