Image-to-Image
PyTorch
ONNX
TensorRT
English
super-resolution
image-restoration
sisr
real-world-restoration
spandrel
chainner
transformer
attention
Instructions to use Phips/HEART with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use Phips/HEART with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
rewrite Why section: academic tone, trainer motivation, community credit
Browse files
README.md
CHANGED
|
@@ -38,30 +38,48 @@ real-world usable first, not benchmark-chasing. See
|
|
| 38 |
|
| 39 |
## Why HEART?
|
| 40 |
|
| 41 |
-
There are strong SR networks already.
|
| 42 |
-
when
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
- **One file, exports cleanly.** Single-file pure PyTorch; dynamic ONNX on the
|
| 55 |
first try; no fusion step or fused/unfused checkpoint pairs.
|
| 56 |
-
- **
|
| 57 |
-
|
|
|
|
|
|
|
| 58 |
|
| 59 |
-
**When to pick something else
|
| 60 |
-
model, use NERVE
|
|
|
|
| 61 |
|
| 62 |
-
Full architecture details, design rationale
|
| 63 |
[`docs/EXPERIMENTS.md`](docs/EXPERIMENTS.md).
|
| 64 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
---
|
| 66 |
|
| 67 |
## Quickstart
|
|
|
|
| 38 |
|
| 39 |
## Why HEART?
|
| 40 |
|
| 41 |
+
There are strong and established SR networks already. This is the honest case
|
| 42 |
+
for when HEART is worth your time — and when it is not.
|
| 43 |
+
|
| 44 |
+
This project comes out of a trainer's frustration rather than a benchmark goal.
|
| 45 |
+
After training hundreds of SISR models (see
|
| 46 |
+
[Phhofm/models](https://github.com/Phhofm/models)), the recurring annoyance was
|
| 47 |
+
networks that felt like *paper* networks: they chase leaderboard metrics with
|
| 48 |
+
techniques that leave you juggling an unfused and a fused checkpoint, or whose
|
| 49 |
+
dynamic-ONNX conversion is fragile. This network is the opposite of that — built
|
| 50 |
+
so a trainer can pick it up, train it, and convert it to dynamic ONNX without
|
| 51 |
+
headaches.
|
| 52 |
+
|
| 53 |
+
**Strengths of HEART**
|
| 54 |
+
- **Real-world usability over metric chasing.** OTF models are trained on the
|
| 55 |
+
full Real-ESRGAN degradation chain and restore real photos, not just clean
|
| 56 |
+
bicubic downsamples.
|
| 57 |
+
- **Competitive quality at lower cost.** In our tests it matches HAT on PSNR
|
| 58 |
+
while using roughly half the peak VRAM and running ~1.6x faster in bf16
|
| 59 |
+
inference.
|
| 60 |
- **One file, exports cleanly.** Single-file pure PyTorch; dynamic ONNX on the
|
| 61 |
first try; no fusion step or fused/unfused checkpoint pairs.
|
| 62 |
+
- **Stable, simple training.** i-LN keeps bf16 AMP stable without fp32
|
| 63 |
+
gymnastics.
|
| 64 |
+
- **FlashAttention / SDPA friendly.** No attention masks, no position-bias
|
| 65 |
+
table lookups — RIB replaces them with a dot product.
|
| 66 |
|
| 67 |
+
**When to pick something else.** For maximum benchmark PSNR or a small mobile
|
| 68 |
+
model, use NERVE or one of the community networks below. HEART is the desktop /
|
| 69 |
+
server quality tier.
|
| 70 |
|
| 71 |
+
Full architecture details, design rationale and ablation results:
|
| 72 |
[`docs/EXPERIMENTS.md`](docs/EXPERIMENTS.md).
|
| 73 |
|
| 74 |
+
**Credit where it is due.** None of this exists in a vacuum. SISR has many
|
| 75 |
+
strong architectures and generous community members, for example HAT, ATD and
|
| 76 |
+
DAT2, the community network work of [umzi](https://github.com/umzi2) and
|
| 77 |
+
[Kim2091](https://github.com/Kim2091), fdat by
|
| 78 |
+
[sharekhan](https://github.com/stinkybread), and
|
| 79 |
+
[the-database](https://github.com/the-database) (traiNNer-redux, its benchmarks
|
| 80 |
+
and its models). This list is far from complete — apologies to anyone not named;
|
| 81 |
+
the SISR community has a great many people contributing a great deal.
|
| 82 |
+
|
| 83 |
---
|
| 84 |
|
| 85 |
## Quickstart
|