Playground

The playground lets you test a single-target model from the AISIX Cloud control plane. Use it to confirm that the model can reach its upstream provider and return a chat response before sending application traffic through the gateway.

Testing Models in the Playground

Playground requests run from the control plane to the upstream provider. Use them to validate the provider key, upstream base URL, model name, and basic prompt response from the control plane UI.

The playground sends OpenAI-compatible chat-completions requests. Use it with single-target models whose provider key points to an OpenAI-compatible upstream base URL, including Anthropic-backed models exposed through an OpenAI-compatible endpoint.

The playground is a simple test tool that calls the provider directly. It does not reproduce gateway behavior: it applies only what a request needs to succeed against common models, as described in Request Parameters.

Playground requests bypass the AISIX gateway, so they are not recorded in Request Logs, Usage, AISIX gateway metrics, or external telemetry exporter output. Budgets and rate limits configured in AISIX Cloud do not apply to playground requests. Each run still calls the upstream provider with the model's provider key, so it consumes provider quota and is billed by the provider like any other API call.

AISIX gateway requests run through the runtime that applications use. Send traffic through the AISIX gateway to validate caller API keys, model aliases, routing rules and failover, cache behavior, guardrails, budgets, rate limits, streaming behavior, logs, usage reporting, and metrics. Use AISIX gateway traffic when you need to validate endpoint families beyond chat completions or provider-specific protocol behavior.

Request Parameters

The playground shapes each request as follows:

• Temperature. The field starts empty and shows Provider default. While it is empty, the request carries no temperature, so the model uses its own default; some models accept only their default and reject any explicit value. Enter a value from 0 to 2 to send it, and select Use default to clear the field and stop sending it.
• Max tokens. The playground sends max_tokens, 1024 by default. For a provider key on the openai or azure-openai adapter, it applies the same reasoning-model token cap as the gateway: a reasoning model receives the value as max_completion_tokens.
• Parameter renames. After that rule, the playground applies the provider key's request.param_renames, so an explicit rename on the key has the last word, as it does on the gateway.

The provider key's other request settings, such as request.param_constraints, request.default_headers, and request.default_body_fields, are not applied to playground requests. Send traffic through the AISIX gateway to test them.

Reach Private-Network Endpoints On Premises

The playground proxy refuses to connect to private, internal, or loopback IP addresses by default. This server-side request forgery (SSRF) protection prevents the control plane from reaching internal network services through a crafted model endpoint. On-Premises may need to reach an LLM endpoint on an internal network, while Hybrid Cloud expects public upstream endpoints. A blocked request fails with the error code UPSTREAM_PRIVATE_IP_BLOCKED.

To let the playground reach a private-network endpoint, set AISIX_PLAYGROUND_ALLOW_PRIVATE_IPS=1 on the control-plane API service and restart it:

• Offline package (Docker Compose): uncomment AISIX_PLAYGROUND_ALLOW_PRIVATE_IPS=1 in .env, then run docker compose up -d api.
• Helm chart: set api.playgroundAllowPrivateIPs=true.

Leave the default in place when your model endpoints are public. This setting affects only the playground proxy; the data plane always reaches upstream providers directly and is unaffected.

Next Steps

Continue with Usage Reporting to understand gateway usage, spend, and budget-related signals.