Text Generation
Transformers.js
ONNX
llama
webgpu
q4f16
gptq
tool-calling
experimental
conversational
Instructions to use webbrain-one/webbrain-compass-tiny-v2.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use webbrain-one/webbrain-compass-tiny-v2.1 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'webbrain-one/webbrain-compass-tiny-v2.1');
Download validation/context-results.json from webbrain-one/webbrain-compass-tiny-v2.1: direct link, hf CLI and curl.
- Browser
- Download file 693 Bytes
-
https://huggingface.co/webbrain-one/webbrain-compass-tiny-v2.1/resolve/main/validation/context-results.json
- Command line
-
hf download hf://webbrain-one/webbrain-compass-tiny-v2.1/validation/context-results.json
-
curl -L -o context-results.json https://huggingface.co/webbrain-one/webbrain-compass-tiny-v2.1/resolve/main/validation/context-results.json
693 Bytes
| { | |
| "status": "passed", | |
| "contextWindowExercised": 16384, | |
| "results": [ | |
| { | |
| "inputTokens": 4088, | |
| "generatedTokens": 8, | |
| "finite": true, | |
| "seconds": 1.199800000190735 | |
| }, | |
| { | |
| "inputTokens": 8184, | |
| "generatedTokens": 8, | |
| "finite": true, | |
| "seconds": 2.257800000190735 | |
| }, | |
| { | |
| "inputTokens": 16376, | |
| "generatedTokens": 8, | |
| "finite": true, | |
| "seconds": 5.950199999809265 | |
| }, | |
| { | |
| "inputTokens": 16383, | |
| "generatedTokens": 1, | |
| "finite": true, | |
| "seconds": 5.6705 | |
| } | |
| ], | |
| "implementationSha256": "6502ce8d72aa9f9a68d9fa8aa646543d1d6bcfa089db92658e4da3af3c2abd80" | |
| } |