Update README.md
Browse files
README.md
CHANGED
|
@@ -49,7 +49,8 @@ The scripts for training the model & generating the initial dataset can be found
|
|
| 49 |
|
| 50 |
We use Androcles in a couple of different ways:
|
| 51 |
|
| 52 |
-
* As a first step in our [AI Gateway Server](https://github.com/brave/ai-gateway/tree/main) powering [Leo](https://brave.com/leo/), classifying prompts into categories with the aim of dynamically changing available tools/instructions depending on what the user asks for
|
|
|
|
| 53 |
* As a 'primary category' labeller for our privacy-preserving Leo Analytics server
|
| 54 |
|
| 55 |
We host it using Nvidia's Triton Inference Server to serve it with low-latency at scale, but we've also used KServe in the past
|
|
|
|
| 49 |
|
| 50 |
We use Androcles in a couple of different ways:
|
| 51 |
|
| 52 |
+
* As a first step in our [AI Gateway Server](https://github.com/brave/ai-gateway/tree/main) powering [Leo](https://brave.com/leo/), classifying prompts into categories with the aim of dynamically changing available tools/instructions depending on what the user asks for
|
| 53 |
+
|
| 54 |
* As a 'primary category' labeller for our privacy-preserving Leo Analytics server
|
| 55 |
|
| 56 |
We host it using Nvidia's Triton Inference Server to serve it with low-latency at scale, but we've also used KServe in the past
|