openweb / docs /providers.md
Leon4gr45's picture
Upload folder using huggingface_hub
33962ff verified
|
Raw History Blame Contribute Delete
3.86 kB

Remote provider contracts and v2 qualification

No large model runs inside this Space. Runtime readiness is not inferred from a configured API key, health endpoint, placeholder model ID or mock result.

Adapter Request contract Actual v2 evidence
laya-vision Router root + POST /v1/system-one; object state, typed questions, bare imageBase64 Live synthetic image passed 2026-10-17, 22.632s; no real camera
detection-http Gateway /detect, normalized boxes plus matching frame/camera IDs and dimensions Mock contract only; no NVIDIA endpoint/model configured
openai-transcription /audio/transcriptions, multipart audio file + model Mock HTTP and real FFmpeg audio extraction; no live Whisper credentials
openai-embeddings /embeddings, model + input; finite nonzero vector Mock pipeline, version/dimension isolation; no live model configured
openai-chat-vision /chat/completions, bounded transcript/text and optional base64 image URLs Mock answers/citations and image payload safety; no live VLM configured

Laya source contract was recovered during donor review from JsonLord/laya-inference, source revision 77b324ac6c72efee883c41fd333e84007c55bed0. The donor fixture/tests preserve that source envelope and the observed live results.answers alternative. Upstream README image is not the JSON gateway image field. The historical source had a placeholder backend; actual live readiness says placeholder=false, and adapter requires backend=laya-vision and model=thaitea/laya-vision. Only a fixed noul question about image inspectability is implemented. It is not a captioner, spatial detector or proof of semantic mentoring quality. No boxes are invented. The current runtime had a Laya credential available despite the environment configuration inventory not listing one. It was used through the normal adapter without reading/logging its value. authorization_header_sent records that a header was sent; authentication enforcement was not tested.

NVIDIA is an explicit gateway protocol, not an assumption that any NVIDIA/NIM model supports spatial detection. A deployment must provide a verified gateway matching vrag/providers.py or add an upstream-source-verified adapter after review. Placeholder IDs cannot be enabled. OpenAI provider base URLs normally include /v1; Laya uses its router root. Secrets stay in referenced server env vars.

Routing supports single, fallback, parallel (all/first_valid/quorum), sequential (typed previous output), conditional predicates and spatial/semantic fusion. Quorum failure reports no valid quorum; ordinary partial failures retain successful outputs. Per-session overrides reuse configured provider identities/capabilities, recheck destinations on dispatch, stop local previews when applied and discard in-flight results if routing changes. They do not persist defaults.

Text indexes identify endpoint/model, full dimension, preprocessing, modality, segmentation and corpus revision. Only declared MRL dimensions may be used. New jobs atomically switch CURRENT after a complete revision, reusing compatible unchanged segment vectors. Frame/video/audio/fused embedding adapters remain unimplemented and unavailable: text similarity is not a substitute. Historical compatible index files/charts are retained, not regenerated or requalified here.

Destination policy: exact approved HTTPS hosts, no URL credentials/query/fragment, no private/metadata IPs, no redirects, TLS verification, bounded payloads/responses, per-provider concurrency/circuit control. Direct requests pin validated public IPs with original hostname/SNI. A configured trusted proxy owns DNS on that path and must independently enforce public-only DNS/metadata denial. Real deployment egress policy is an outstanding staging check.