Instructions to use AlayaLab/KaiNinja with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Trellis
How to use AlayaLab/KaiNinja with Trellis:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add weights
Browse files- README.md +32 -0
- stage1_layout_flow.json +28 -0
- stage1_layout_flow.safetensors +3 -0
- stage2_slat_flow.json +29 -0
- stage2_slat_flow.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: image-to-3d
|
| 4 |
+
tags:
|
| 5 |
+
- 3d-generation
|
| 6 |
+
- part-aware
|
| 7 |
+
- trellis
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# KaiNinja
|
| 11 |
+
|
| 12 |
+
Weights of KaiNinja, a part-aware image-to-3D generator built on TRELLIS.2.
|
| 13 |
+
|
| 14 |
+
| File | Stage | Model | Weights |
|
| 15 |
+
|---|---|---|---|
|
| 16 |
+
| `stage1_layout_flow.safetensors` | Stage 1, dual-volume sparse-structure flow | `TriSparseStructureFlowModel` | step 75k |
|
| 17 |
+
| `stage2_slat_flow.safetensors` | Stage 2, dual-stream structured-latent flow | `TriSLatSeparateFlowModel` | EMA (0.9999), step 100k |
|
| 18 |
+
|
| 19 |
+
The matching `*.json` files hold the model constructor arguments. The shape decoder is the original
|
| 20 |
+
TRELLIS.2 one and is not included here.
|
| 21 |
+
|
| 22 |
+
## Inference settings
|
| 23 |
+
|
| 24 |
+
- Stage 1: Euler flow sampler, 50 steps, classifier-free guidance 3.0; the two decoded volumes go
|
| 25 |
+
through overlap deduplication before Stage 2.
|
| 26 |
+
- Stage 2: Euler flow sampler, 50 steps, classifier-free guidance 3.0.
|
| 27 |
+
- Each volume is decoded with the TRELLIS.2 shape decoder; parts are the connected components within
|
| 28 |
+
each volume.
|
| 29 |
+
|
| 30 |
+
## License
|
| 31 |
+
|
| 32 |
+
MIT, as the base model.
|
stage1_layout_flow.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"name": "TriSparseStructureFlowModel",
|
| 3 |
+
"args": {
|
| 4 |
+
"resolution": 16,
|
| 5 |
+
"channels_per_stream": 8,
|
| 6 |
+
"num_streams": 2,
|
| 7 |
+
"model_channels": 1536,
|
| 8 |
+
"cond_channels": 1024,
|
| 9 |
+
"num_blocks": 30,
|
| 10 |
+
"num_heads": 12,
|
| 11 |
+
"mlp_ratio": 5.3334,
|
| 12 |
+
"pe_mode": "rope",
|
| 13 |
+
"share_mod": true,
|
| 14 |
+
"qk_rms_norm": true,
|
| 15 |
+
"qk_rms_norm_cross": true,
|
| 16 |
+
"dtype": "bfloat16",
|
| 17 |
+
"weight_share": "separate",
|
| 18 |
+
"cross_volume_at": [
|
| 19 |
+
6,
|
| 20 |
+
12,
|
| 21 |
+
18,
|
| 22 |
+
24,
|
| 23 |
+
29
|
| 24 |
+
],
|
| 25 |
+
"per_stream_io": true,
|
| 26 |
+
"rope_stream_offset": 16.0
|
| 27 |
+
}
|
| 28 |
+
}
|
stage1_layout_flow.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e1d430ce4677d709be4a3035ef401c8413a3224a1cea00455273b91aa95737a1
|
| 3 |
+
size 5733917816
|
stage2_slat_flow.json
ADDED
|
@@ -0,0 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"name": "TriSLatSeparateFlowModel",
|
| 3 |
+
"args": {
|
| 4 |
+
"resolution": 32,
|
| 5 |
+
"in_channels": 32,
|
| 6 |
+
"out_channels": 32,
|
| 7 |
+
"model_channels": 1536,
|
| 8 |
+
"cond_channels": 1024,
|
| 9 |
+
"num_blocks": 30,
|
| 10 |
+
"num_heads": 12,
|
| 11 |
+
"mlp_ratio": 5.3334,
|
| 12 |
+
"share_mod": true,
|
| 13 |
+
"qk_rms_norm": true,
|
| 14 |
+
"qk_rms_norm_cross": true,
|
| 15 |
+
"global_attn_at": [
|
| 16 |
+
2,
|
| 17 |
+
5,
|
| 18 |
+
8,
|
| 19 |
+
11,
|
| 20 |
+
14,
|
| 21 |
+
17,
|
| 22 |
+
20,
|
| 23 |
+
23,
|
| 24 |
+
26,
|
| 25 |
+
29
|
| 26 |
+
],
|
| 27 |
+
"num_streams": 2
|
| 28 |
+
}
|
| 29 |
+
}
|
stage2_slat_flow.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cb252ad8997ecacaef7f20e667f9bab38ef19dd014d1199c0e9ea272991c6946
|
| 3 |
+
size 2619732720
|