Add hosted inference section

#2
by KlangCalpa - opened
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -74,6 +74,24 @@ for word in hypotheses[0].timestamp["word"]:
74
  print(word["start"], word["end"], word["word"])
75
  ```
76
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
  ## Quality and speed
78
 
79
  Word error rate (WER, %) on Swedish speech; lower is better. All models were evaluated by Klang using the same scoring procedure. Bulk throughput is expressed as multiples of realtime.
 
74
  print(word["start"], word["end"], word["word"])
75
  ```
76
 
77
+ ## Hosted inference
78
+
79
+ If you would rather not run the weights yourself, Pianissimo is served by
80
+ [Berget AI](https://berget.ai) on Swedish infrastructure. The realtime endpoint is compatible
81
+ with the OpenAI Realtime API, so an existing client needs a new base URL and key.
82
+
83
+ ```
84
+ wss://api.berget.ai/v1/realtime?intent=transcription
85
+ model: klang/pianissimo
86
+ ```
87
+
88
+ Audio goes in as PCM16 mono and transcript deltas come back while the speaker is still talking.
89
+
90
+ Runnable examples for both paths, hosted and local, are in
91
+ [klang-ai/pianissimo-examples](https://github.com/klang-ai/pianissimo-examples).
92
+
93
+ Pianissimo is made by [Klang](https://klang.ai/pianissimo/?utm_source=huggingface&utm_medium=referral&utm_campaign=pianissimo-subtitles&utm_content=model-card).
94
+
95
  ## Quality and speed
96
 
97
  Word error rate (WER, %) on Swedish speech; lower is better. All models were evaluated by Klang using the same scoring procedure. Bulk throughput is expressed as multiples of realtime.