Spaces:
Running
Running
File size: 9,840 Bytes
b29b21e 883d3ec b29b21e 849c885 cd58339 e4fb1f3 849c885 869dd82 4e85def cd58339 a27de67 a50ad5d 4e85def cd58339 04f8d63 cd58339 04f8d63 4e85def cd58339 9069070 b96ca22 59155e9 88604f7 7069475 e5dce18 59155e9 cd58339 acea25d 59155e9 cd58339 4e85def cd58339 a27de67 cd58339 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 | ---
title: README
emoji: 🌍
colorFrom: gray
colorTo: purple
sdk: static
pinned: false
---
<!-- header start -->
<!-- 200823 -->
<a href="https://www.pruna.ai/?utm_source=huggingface&utm_medium=org_card&utm_campaign=hf_traffic" target="_blank" rel="noopener noreferrer">
<img src="https://github.com/PrunaAI/pruna/raw/main/docs/assets/images/logo.png"
alt="PrunaAI"
style="width: 50%; min-width: 400px; display: block; margin: 0;">
</a>
<!-- header end -->
----
## 🌍 Join the Pruna AI community!
[](https://github.com/PrunaAI/pruna)
[](https://twitter.com/PrunaAI)
[](https://www.linkedin.com/company/pruna-ai)
[](https://discord.com/invite/JFQmtFKCjd)
[](https://dashboard.pruna.ai/login?utm_source=huggingface&utm_medium=org_card&utm_campaign=hf_traffic)
----
## 💜 Make AI models faster, cheaper, smaller, greener!
[Pruna AI](https://www.pruna.ai/) makes AI models faster, cheaper, smaller, and greener with the `pruna` package.
- It supports **various models, including CV, NLP, audio, and graphs for predictive and generative AI**.
- It supports **various hardware, including GPU, CPU, Edge**.
- It supports **various compression algorithms**, including quantization, pruning, distillation, caching, recovery, compilation, or factorization, among others.
- You can **combine algorithms** to find the optimal configuration and smash/compress your model.
- You can **evaluate reliable quality and efficiency metrics** of your base vs smashed/compressed models.
**Set it up in minutes and compress your first models in a few lines of code!**
----
## ⏩ How to get started?
You can smash your own models by installing [pruna](https://github.com/PrunaAI/pruna) with pip:
```py
pip install pruna
```
You can start with simple notebooks to experience efficiency gains with:
| Use Case | Free Notebooks |
|------------------------------------------------------------|----------------------------------------------------------------|
| **3x Faster Stable Diffusion Models** | ⏩ [Smash for free](https://colab.research.google.com/github/PrunaAI/pruna/blob/main/docs/tutorials/sd_deepcache.ipynb) |
| **Making your LLMs 4x smaller** | ⏩ [Smash for free](https://colab.research.google.com/github/PrunaAI/pruna/blob/main/docs/tutorials/llms.ipynb) |
| **Smash your model with a CPU only** | ⏩ [Smash for free](https://colab.research.google.com/github/PrunaAI/pruna/blob/main/docs/tutorials/cv_cpu.ipynb) |
| **Transcribe 2 hours of audio in less than 2 minutes with Whisper** | ⏩ [Smash for free](https://colab.research.google.com/github/PrunaAI/pruna/blob/main/docs/tutorials/asr_tutorial.ipynb) |
| **100% faster Whisper Transcription** | ⏩ [Smash for free](https://colab.research.google.com/github/PrunaAI/pruna/blob/main/docs/tutorials/asr_tutorial.ipynb) |
| **Run your Flux model without an A100** | ⏩ [Smash for free](https://githubtocolab.com/PrunaAI/pruna/blob/1d68f74c132bd4045f2af55bb1e5c03bf2dde6a9/docs/tutorials/flux_small.ipynb) |
| **x2 smaller Sana in action** | ⏩ [Smash for free](https://colab.research.google.com/github/PrunaAI/pruna/blob/main/docs/tutorials/sana_diffusers_int8.ipynb) |
For more details on installation and free tutorials, check the [Pruna AI documentation](https://docs.pruna.ai/).
----
## ✨ Test our Performance Models
Want to use our optimized models right away? Try them [via our API](https://www.pruna.ai/all-models) for fast, easy access to Pruna-powered inference.
<style>
.model-button {
display: inline-flex;
flex-direction: row;
justify-content: center;
align-items: center;
gap: 8px;
padding: 8px 20px;
border: none;
border-radius: 8px;
background: #9334e9;
color: #ffffff;
font-size: 14px;
font-weight: 400;
line-height: 1;
text-decoration: none;
white-space: nowrap;
cursor: pointer;
box-sizing: border-box;
overflow: visible;
opacity: 1;
}
</style>
<a href="https://dashboard.pruna.ai/login?utm_source=huggingface&utm_medium=org_card&utm_campaign=hf_traffic" class="model-button">Try our models</a> |