Delete README.md with huggingface_hub
Browse files
README.md
DELETED
|
@@ -1,38 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
library_name: cellm
|
| 3 |
-
tags:
|
| 4 |
-
- mobile
|
| 5 |
-
- rust
|
| 6 |
-
- memory-efficient
|
| 7 |
-
- quantized
|
| 8 |
-
---
|
| 9 |
-
|
| 10 |
-
# Cellm Models Hub
|
| 11 |
-
|
| 12 |
-
This repository contains a collection of optimized Large Language Models (LLMs) in the `.cellm` format. These models are specifically tuned for high-performance inference using the [Cellm](https://github.com/jeffasante/cellm) engine, featuring Metal-accelerated kernels and memory-mapped efficiency.
|
| 13 |
-
|
| 14 |
-
## Models
|
| 15 |
-
|
| 16 |
-
### Gemma 3 1B IT (Int8)
|
| 17 |
-
- **Path**: `gemma-3-1b-it-int8/gemma-3-1b-it-int8.cellmd`
|
| 18 |
-
- **Size**: 1.3 GB
|
| 19 |
-
- **Type**: Quantized Int8 (Symmetric Weight-Only)
|
| 20 |
-
|
| 21 |
-
### Gemma 4 2.3B IT (LiteRT)
|
| 22 |
-
- **Path**: `gemma-4-2p3b-it-litert/gemma-4-2p3b-it-litert.cellm`
|
| 23 |
-
- **Size**: 2.4 GB
|
| 24 |
-
- **Type**: LiteRT-optimized for Cellm
|
| 25 |
-
|
| 26 |
-
## Usage
|
| 27 |
-
|
| 28 |
-
You can use these models directly with the Cellm CLI or in your applications:
|
| 29 |
-
|
| 30 |
-
```bash
|
| 31 |
-
cellm run --model-path jeffasante/cellm-models/gemma-4-2p3b-it-litert/gemma-4-2p3b-it-litert.cellm
|
| 32 |
-
```
|
| 33 |
-
|
| 34 |
-
## About Cellm
|
| 35 |
-
Cellm is a high-performance inference engine for local LLMs, written in Rust with a focus on Metal GPU acceleration and minimal memory overhead.
|
| 36 |
-
|
| 37 |
-
## License
|
| 38 |
-
This model is subject to the **Gemma Terms of Use**. By downloading or using these weights, you agree to the terms listed at [ai.google.dev/gemma/terms](https://ai.google.dev/gemma/terms).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|