Instructions to use JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("JackIsNotInTheBox/Generate_Audio_for_Video_Checkpoints", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Commit History
-
Mirror README.md from cvssp/audioldm2@c8e7e189
Verified signature0323246 -
Mirror vocab.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signaturecc07895 -
Mirror tokenizer_config.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature8be1bc6 -
Mirror tokenizer.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature947ef91 -
Mirror special_tokens_map.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature46d6a02 -
Mirror pytorch_model.bin from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signatured689aff -
Mirror preprocessor_config.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature1f07946 -
Mirror open_clip_pytorch_model.bin from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signaturea9d0674 -
Mirror open_clip_config.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature1cbd3be -
Mirror merges.txt from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature7a19ed0 -
Mirror eval_results.jsonl from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature20b86b4 -
Mirror config.json from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signatureb3a8766 -
Mirror README.md from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature75ef6d4 -
Mirror LICENSE from apple/DFN5B-CLIP-ViT-H-14-378@01b771ed
Verified signature328a514 -
Mirror vocab.json from laion/larger_clap_general@ada0c23a
Verified signaturef04a658 -
Mirror tokenizer_config.json from laion/larger_clap_general@ada0c23a
Verified signatureaf6902f -
Mirror tokenizer.json from laion/larger_clap_general@ada0c23a
Verified signature4fcf1ec -
Mirror special_tokens_map.json from laion/larger_clap_general@ada0c23a
Verified signature4c2ba51 -
Mirror pytorch_model.bin from laion/larger_clap_general@ada0c23a
Verified signatureeeb8734 -
Mirror preprocessor_config.json from laion/larger_clap_general@ada0c23a
Verified signature36bf52a -
Mirror merges.txt from laion/larger_clap_general@ada0c23a
Verified signaturec3cdee5 -
Mirror config.json from laion/larger_clap_general@ada0c23a
Verified signaturee7c81a8 -
Mirror README.md from laion/larger_clap_general@ada0c23a
Verified signature9876a75 -
Mirror tokenizer_config.json from google/siglip2-base-patch16-512@a89f5c50
Verified signaturef23de85 -
Mirror tokenizer.model from google/siglip2-base-patch16-512@a89f5c50
Verified signature526f4f5 -
Mirror tokenizer.json from google/siglip2-base-patch16-512@a89f5c50
Verified signaturef302ef4 -
Mirror special_tokens_map.json from google/siglip2-base-patch16-512@a89f5c50
Verified signature37b0a06 -
Mirror preprocessor_config.json from google/siglip2-base-patch16-512@a89f5c50
Verified signature21e5127 -
Mirror model.safetensors from google/siglip2-base-patch16-512@a89f5c50
Verified signature04c8066 -
Mirror config.json from google/siglip2-base-patch16-512@a89f5c50
Verified signature4696f5f -
Mirror README.md from google/siglip2-base-patch16-512@a89f5c50
Verified signature6aaa930 -
Mirror weights/mmaudio_small_44k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signaturef0ba17a -
Mirror weights/mmaudio_small_16k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature7f40a21 -
Mirror weights/mmaudio_medium_44k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature5d66932 -
Mirror weights/mmaudio_large_44k_v2.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature9b2b500 -
Mirror weights/mmaudio_large_44k.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature3be171e -
Mirror ext_weights/v1-44.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature2696969 -
Mirror ext_weights/v1-16.pth from hkchengrex/MMAudio@eb13a1a9
Verified signatureb19717b -
Mirror ext_weights/synchformer_state_dict.pth from hkchengrex/MMAudio@eb13a1a9
Verified signature264683f -
Mirror ext_weights/best_netG.pt from hkchengrex/MMAudio@eb13a1a9
Verified signaturef8a2b9f -
Mirror examples/sora_serpent.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signatureb22140f -
Mirror examples/sora_seahorse.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturea619da6 -
Mirror examples/sora_nyc.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturee6a6666 -
Mirror examples/sora_kraken.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signatureb48d131 -
Mirror examples/sora_india.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signature683faf6 -
Mirror examples/sora_galloping.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signature18cd146 -
Mirror examples/sora_beach.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturef8746e8 -
Mirror examples/mochi_storm.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signature75091fe -
Mirror examples/hunyuan_wake_up.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturee88efb0 -
Mirror examples/hunyuan_typing.mp4 from hkchengrex/MMAudio@eb13a1a9
Verified signaturead8a181