Home / Documentation / Configuration Guide

LLM Provider Management

Metadata-driven with intelligent routing

LLM provider management is Neurova's model infrastructure: unified administration of many LLM vendors, metadata-driven, with automatic discovery, intelligent routing and user isolation.

Core capabilities

CapabilityDescriptionStatus
Metadatacapability / series / priority / scope metadataImplemented
Automatic discoveryA three-tier probe chain (metadata → model list → capability probe)Implemented
Intelligent filteringMulti-dimensional selection by capability / series / vendorImplemented
Candidate mergingIdempotent merge logicImplemented
OpenCodeAn additional OpenCode-compatible vendorImplemented
Async streamingProvider methods made asyncImplemented
User isolationScope-level isolation, with API keys managed per userImplemented

Intelligent routing

request type detection (CHAT / VISION / TTS / STT / IMAGE_GENERATION ...)
    ↓
capability matching → health check → priority ordering → response time optimization → weighted scoring
    ↓
best model selected

API

GET  /api/v1/provider            # provider list (with metadata)
POST /api/v1/provider            # add a provider
POST /api/v1/provider/discover   # automatic discovery
GET  /api/v1/model               # model management