Skip to main content

AI Routing

Create a Route​

Open the console, select AI Routing from the left navigation to enter the route list, then click Create Route and configure the parameters in the creation panel:

Configuration​

  • Route Name: A custom display name for the route
  • Domains: Supports selecting multiple domains

Routing Types​

Two types are supported: single-model service and multi-model service.

  • Single‑model service: Run only one model in the same service instance. Best for scenarios that focus on a single task or model.
  • Model name matching: Support both prefix matching and exact matching of model names, and route matched requests to the specified integration. Multiple name-matching rules can be configured at the same time.
  • Load balancing: Route the same model name to multiple integrations with configurable weights.

Integrations​

Choose the target integration(s) from the integration list.

Note: In the public cloud version, automatic routing is enabled; manual user configuration is not yet supported.