File size: 4,965 Bytes
4e9b6b7 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 | ---
license: apache-2.0
base_model: lakucho/MOSS-Audio-8B-Instruct
tags:
- comfyui
- safetensors
- repackaged
pipeline_tag: audio-text-to-text
language:
- en
- zh
---
# MOSS-Audio-8B-Instruct-ComfyUI
Instruction-following audio understanding and transcription with text output.
This is a converted model package for [Jack Spooner’s ComfyUI fork](https://github.com/jackspooner/ComfyUI), derived from [lakucho/MOSS-Audio-8B-Instruct](https://huggingface.co/lakucho/MOSS-Audio-8B-Instruct/tree/8bd5b22c64dd80b59c06af4e3304e581a3e5596b). It is not a new fine-tune.
## Required code
The integration modifies ComfyUI core; this is not a drop-in `custom_nodes` package.
- [Model integration commit](https://github.com/jackspooner/ComfyUI/commit/624b1ae48b67ba7fc0fae074e77f6091fbb68633)
- [Implementation](https://github.com/jackspooner/ComfyUI/blob/9d9053c5e7a272f1769886f4d89b6f8a7c79c785/comfy/text_encoders/moss_audio.py) · [Offline converter](https://github.com/jackspooner/ComfyUI/blob/9d9053c5e7a272f1769886f4d89b6f8a7c79c785/scripts/convert_moss_audio.py)
- [Development branch](https://github.com/jackspooner/ComfyUI/tree/moss-audio-native) · [Pinned compatible reference snapshot `9d9053c5e`](https://github.com/jackspooner/ComfyUI/tree/9d9053c5e7a272f1769886f4d89b6f8a7c79c785)
- [Installation, node usage and acceptance details](https://github.com/jackspooner/ComfyUI/blob/9d9053c5e7a272f1769886f4d89b6f8a7c79c785/docs/moss-audio.md)
For an existing ComfyUI installation, use the linked core changes and their prerequisites against a compatible base. The integration commit alone is not asserted to be an independently cherry-pickable patch. The pinned reference snapshot includes the required shared loaders, attention and memory changes. Follow the fork’s installation README and dependencies when reproducing that snapshot; update the application only while its queue is idle. Upstream ComfyUI is [Comfy-Org/ComfyUI](https://github.com/Comfy-Org/ComfyUI); its [README](https://github.com/Comfy-Org/ComfyUI/blob/master/README.md) describes the underlying node engine and model management.
## Files and installation
Place `moss_audio_8b_instruct_bf16.safetensors` in `ComfyUI/models/text_encoders/`. The tokenizer and required inference configuration are embedded; original HF shards are not required at inference.
| File | Size |
| --- | ---: |
| `moss_audio_8b_instruct_bf16.safetensors` | 18.110 GB |
Manifest/provenance files record the conversion and source revisions. `SHA256SUMS` and `FILES.json` describe this release. Filenames and model folders matter. No original source snapshot needs to be converted again.
## Usage
Select `moss_audio_8b_instruct_bf16.safetensors` in **Load CLIP**, type **moss_audio**. Connect CLIP to **Generate Text** and **Load Audio** to its audio input. Use a specific transcription, captioning or audio question prompt and an explicit output budget. Start with thinking disabled for this Instruct checkpoint; the control changes the prompt and is not a different set of weights. Select your own audio in the example.
Example graphs are in [workflows](workflows/README.md).
## Verification and limits
The package has pinned conversion provenance. Native Instruct participation in the Omni model-transition/lifecycle fixture is documented. The larger full-model caption/reference acceptance suite was conducted for Thinking and must not be assumed to validate this Instruct variant. This is a converted release with bounded variant acceptance. Exact timestamps, recognition accuracy, low-VRAM operation and other backends are not guaranteed.
These statements describe the linked retained tests, not a new cross-platform acceptance suite. File size is not a minimum RAM/VRAM requirement. No inference-time downloads or external inference worker are required by these native model paths.
## Conversion and provenance
Repackages the exact lakucho mirror revision, preserving 901 BF16 source tensors and embedding its tokenizer. This is an OpenMOSS model distributed via that mirror; it is not our fine-tune.
Source model revision: `8bd5b22c64dd80b59c06af4e3304e581a3e5596b`. See [PROVENANCE.json](PROVENANCE.json), the conversion manifest and [NOTICE](NOTICE). No training data, private inputs or generated user recordings are included.
## License and attribution
The pinned mirror model card declares Apache-2.0 and credits OpenMOSS. Both the actual source mirror and the original OpenMOSS authors are attributed.
See [LICENSE](LICENSE), [NOTICE](NOTICE), and the retained upstream model card/source notices. Model authors and publishers retain credit; this is a third-party ComfyUI repackaging and does not imply endorsement. The weights’ terms and the separately linked ComfyUI code license are distinct.
The example workflow files are copied/adapted from the linked ComfyUI fork; its GPL-3.0 license is retained in `LICENSES/COMFYUI-GPL-3.0.txt`. This does not relicense the model weights.
|