File size: 661 Bytes
b13428f
8e4b0b2
b13428f
8e4b0b2
 
eb27a2b
 
 
 
b13428f
 
 
 
 
8e4b0b2
eb27a2b
8e4b0b2
 
 
 
 
 
 
 
 
eb27a2b
8e4b0b2
b13428f
8e4b0b2
b13428f
8e4b0b2
b13428f
8e4b0b2
b13428f
8e4b0b2
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
---
title: Kimi K3 AirLLM Demo
emoji: 🤖
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: "5.38.0"
python_version: "3.10"
app_file: app.py
pinned: false
---

# Kimi K3 + AirLLM

A Gradio demonstration of `devoppro/Kimi-K3` using AirLLM for memory-efficient inference.

The model cache is stored on the attached persistent `/data` volume.

## Model

`devoppro/Kimi-K3`

## Backend

AirLLM + Transformers

## Storage

The Space expects a persistent volume mounted at:

`/data`

The model can require a very large amount of persistent storage.

> First startup can take a long time because the Kimi K3 checkpoint consists of many large safetensor shards.