Spaces:

---

huggingface

/

HuggingDiscussions

Like 98

Running

Love that I can call DeepSeek R1 directly from the Hub 🔥

from huggingface_hub import InferenceClient

client = InferenceClient(
    provider="together",
    api_key="xxxxxxxxxxxxxxxxxxxxxxxx"
)

messages = [
    {
        "role": "user",
        "content": "What is the capital of France?"
    }
]

completion = client.chat.completions.create(
    model="deepseek-ai/DeepSeek-R1", 
    messages=messages, 
    max_tokens=500
)

print(completion.choices[0].message)

Is it possible to set a monthly payment budget or rate limits for all the external providers? I don't see such options in billings tab. In case a key is or session token is stolen, it can be quite dangerous to my thin wallet:(

@benhaotang you already get spending notifications when crossing important thresholds ($10, $100, $1,000) but we'll add spending limits in the future

@benhaotang you already get spending notifications when crossing important thresholds ($10, $100, $1,000) but we'll add spending limits in the future

Thanks for your quick reply, good to know!

Would be great if you could add Nebius AI Studio to the list :) New inference provider on the market, with the absolute cheapest prices and the highest rate limits...

Could be good to add featherless.ai

TitanML !!

Hey! I'm the founder of Kitani an inference API provider serving open source LLMs. We're interested in becoming an official Hugging Face Inference Provider and routing HF inference traffic through our infrastructure.

We already have an OpenAI compatible API and production inference infrastructure. @Wauplin @julien-c , would either of you be able to point me to the right person to coordinate a provider integration with?

Thanks!

My emails admin@kitani.ai

Hi Hugging Face team,

We would like to register as a Hugging Face Inference Provider.

We operate a GPU-backed OpenAI-compatible inference gateway and would like to make GLM-5.3 available through Hugging Face Inference Providers.

Provider information:

• Proposed provider name: Yuxuan
• Model: zai-org/GLM-5.3 / GLM-5.3
• API Base URL: https://api.chunheaj.top/v1
• Models endpoint: https://api.chunheaj.top/v1/models
• Chat Completions endpoint: https://api.chunheaj.top/v1/chat/completions
• Supported task: conversational
• Supported features: chat completions, SSE streaming, token usage reporting, OpenAI-compatible request/response format
• Initial capacity: conservative concurrency of 4 requests to maintain stable latency and reliability

We can provide private test API credentials for validation and are ready to coordinate on the next steps, including the required provider organization setup, model mappings, billing endpoint, and client integration.

Could someone from the Hugging Face Inference Providers team confirm the next onboarding steps and the correct person to coordinate with?

For private coordination and test credentials, please contact us at: gaoja2026@gmail.com

Thank you.

Hi Hugging Face team,

Apres Dynamics (huggingface.co/ApresDynamics) for embeddings, reranking, classification, and light generation.

We saw the note on PR #2491 about the consolidation phase. Are you currently accepting new Inference Provider partners, and is there a waitlist we can join?

Thanks,
Michael Lewis
@ApresDynamics
michael@apresski.ai

Hi Hugging Face team,

We are working on register as provider for our own models, we have questions about model serving provider registration process, we would appreciate it if someone from the relevant team could get in touch to discuss the registration process and requirements.

We'd like to register BosonAI as an Inference Provider for text-to-speech. BosonAI trained and publishes both models — we're the original model developer, not a third-party inference reseller, so our serving stack is built and tuned specifically for this architecture.

Provider details:

• Name: BosonAI, proposed provider id bosonai
• Hugging Face organization: https://huggingface.co/bosonai
• Website: https://boson.ai

Initial models, task text-to-speech:

• https://huggingface.co/bosonai/higgs-tts-3-4b
• https://huggingface.co/bosonai/higgs-tts-2-3b-base

Both models are already deployed and serving production traffic on our own infrastructure
at https://api.boson.ai/v1/audio/speech.

Current status against the register-as-a-provider guide:

• Task API: live in production; not yet in HF's text-to-speech input/output schema —
  happy to either adapt on our side or provide the mapping for a huggingface.js provider
  helper, whichever you prefer.
• Billing endpoint: implementing now (Inference-Id header + idempotent cost-in-nanoUSD
  endpoint per spec).
• huggingface.js integration: not yet started, pending your guidance on provider id and
  sequencing.

Thank you!

Best,
Bang Liu
@BosonAI
bang@boson.ai

Hello! I’m representing Nagame (https://huggingface.co/nagameai), and we’d like to onboard as an Inference Provider.

Our OpenAI-compatible API supports streaming, tool calling, and structured output.

API: https://api.nagame.ai
Models and pricing: https://api.nagame.ai/v1/models
Billing: https://api.nagame.ai/integrations/huggingface/billing
Request-ID header: Inference-Id

Our initial provider model IDs are qwen3.8-27b and qwen3.6-35b-a3b. We would prefer to start validation with Qwen3.8 while including both models in the integration.

Both passed our live functional and billing checks. We plan to submit the JavaScript SDK integration.

Could you advise on onboarding, organization plan requirements, server-side enablement, and secure credential exchange? Our proposed provider slug is nagame.

Quick update on Nagame: we have now completed the initial huggingface.js integration and opened the upstream PR:

https://github.com/huggingface/huggingface.js/pull/2512

The implementation and tests are ready, and direct API smoke tests are passing.

We are ready to proceed with the next onboarding steps. Please let us know if we should upgrade the nagameai organization to Team now for Model Mapping API enablement, and how you would like us to securely provide the provider credentials.

cc @julien-c @Wauplin @sbrandeis
contact@nagame.ai
Thanks!

Hi Hugging Face team 👋

We're Inferway, an OpenAI-compatible inference API running on our own GPUs, and we'd like to join Inference Providers.

Model

• XiaomiMiMo/MiMo-V2.6-Flash-RL → inferway/mimo-v2.6-flash (conversational)
• 393K context · $0.14 / $0.28 per 1M input / output tokens

Ready on our side

• OpenAI-compatible chat completions, JSON and streaming
• An Inference-Id header on every response, and a billing endpoint that follows your spec
• Pricing and context length on /v1/models
• Checked against your validation criteria: about 0.8 s streaming TTFT, tool calling and structured output work
• huggingface.js PR: #2540

Next step

We've created the inferway org and will upgrade it to Team. Could you enable us server-side so we can register the model mapping? We can share a review key privately.

cc @julien-c @Wauplin @SBrandeis @celinah

Thanks!

Inferway · hello@inferway.ai