BradPowar commited on
Commit
ba91dca
·
verified ·
1 Parent(s): f8dc6ed

Enrich org card: pricing table, usage examples, model browser link (patterns from Groq/DeepInfra/Cerebras provider pages)

Browse files
Files changed (1) hide show
  1. README.md +56 -16
README.md CHANGED
@@ -9,29 +9,69 @@ pinned: false
9
 
10
  # IntelCS-AI
11
 
12
- We run an **inference provider** on the Hugging Face Inference Providers
13
- platform: open-weight models served on rented GPU capacity, sold at
14
- marketplace prices.
15
 
16
- ## What we offer
17
 
18
- - **OpenAI-compatible endpoints** (`/v1/chat/completions`, `/v1/models`)
19
- behind the HF Inference Providers API.
20
- - **Tool calling** (function calling) and **structured output**
21
- (`response_format: json_schema`) support.
22
- - **Low-latency serving**: time-to-first-token well under the 5 s budget
 
 
23
  (measured ~0.9 s non-streaming).
24
  - **Autoscaling fleet**: capacity scales out automatically with demand;
25
  routing, metering, and billing run on edge infrastructure.
26
 
27
- ## Currently serving
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
 
29
- | Model | Notes |
30
- |---|---|
31
- | `google/gemma-3-4b-it` | 131K context, tool calling, JSON schema output |
 
 
 
 
 
 
32
 
33
- Model lineup rotates as we add capacity — watch this space.
34
 
35
- ## Links
36
 
37
- - Website: [intelcs.ai](https://intelcs.ai)
 
9
 
10
  # IntelCS-AI
11
 
12
+ **Low-cost inference for open-weight models.** We serve open models on
13
+ efficient GPU capacity at some of the lowest per-token prices on the
14
+ platform — with no compromise on features.
15
 
16
+ > Browse [models served by IntelCS-AI on Hugging Face](https://huggingface.co/models?inference_provider=intelcs-ai&sort=trending)
17
 
18
+ ## Why IntelCS-AI
19
+
20
+ - **Price-first**: open-weight models at floor prices — see the table below.
21
+ - **Full feature parity**: tool calling (function calling) and structured
22
+ output (`response_format: json_schema`) on every conversational model.
23
+ - **Long context**: up to 131K tokens of context on supported models.
24
+ - **Low latency**: time-to-first-token well under the 5 s provider budget
25
  (measured ~0.9 s non-streaming).
26
  - **Autoscaling fleet**: capacity scales out automatically with demand;
27
  routing, metering, and billing run on edge infrastructure.
28
 
29
+ ## Pricing
30
+
31
+ | Model | Input (per 1M tokens) | Output (per 1M tokens) | Context |
32
+ |---|---|---|---|
33
+ | `google/gemma-3-4b-it` | $0.05 | $0.10 | 131K |
34
+
35
+ Our lineup rotates as we add capacity — the freshest list is always on the
36
+ [models page](https://huggingface.co/models?inference_provider=intelcs-ai&sort=trending).
37
+
38
+ ## Usage
39
+
40
+ OpenAI-compatible, through the standard Hugging Face clients:
41
+
42
+ ```python
43
+ from huggingface_hub import InferenceClient
44
+
45
+ client = InferenceClient(
46
+ model="google/gemma-3-4b-it",
47
+ provider="intelcs-ai",
48
+ )
49
+
50
+ # Chat with tool calling
51
+ response = client.chat.completions.create(
52
+ messages=[{"role": "user", "content": "What's the weather in Berlin?"}],
53
+ tools=[{
54
+ "type": "function",
55
+ "function": {
56
+ "name": "get_weather",
57
+ "parameters": {"type": "object", "properties": {"location": {"type": "string"}}},
58
+ },
59
+ }],
60
+ )
61
+ print(response.choices[0].message.tool_calls)
62
 
63
+ # Structured output
64
+ response = client.chat.completions.create(
65
+ messages=[{"role": "user", "content": "Extract the city: 'Flight to Berlin delayed'"}],
66
+ response_format={"type": "json_schema", "json_schema": {"name": "city", "schema": {
67
+ "type": "object", "properties": {"city": {"type": "string"}}, "required": ["city"],
68
+ }}},
69
+ )
70
+ print(response.choices[0].message.content) # {"city": "Berlin"}
71
+ ```
72
 
73
+ Streaming (`stream=True`) is fully supported and metered per token.
74
 
75
+ ## Resources
76
 
77
+ - **Website**: [intelcs.ai](https://intelcs.ai)