Image-to-Image
PyTorch
ONNX
TensorRT
English
super-resolution
image-restoration
sisr
real-world-restoration
spandrel
chainner
transformer
attention
Instructions to use Phips/HEART with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use Phips/HEART with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
embed speed chart + consumer note + cross-links
Browse files
README.md
CHANGED
|
@@ -34,6 +34,10 @@ Part of the **BODY** suite by **Philip Hofmann** — networks built to be
|
|
| 34 |
real-world usable first, not benchmark-chasing. See
|
| 35 |
[Relation to NERVE](#relation-to-nerve) for which one to pick.
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
> Short version: copy `heart_arch.py` into traiNNer-redux, train with
|
| 38 |
> `lq_size: 96`, export to ONNX, run it (ONNX Runtime verified). Details below.
|
| 39 |
|
|
@@ -317,6 +321,8 @@ options as NERVE's published config (`builderOptimizationLevel=5` + CUDA graphs)
|
|
| 317 |
| HEART 4x OTF GAN | 16.7M | 809 ms | 753 ms | **270 ms** | 679 MB |
|
| 318 |
| HAT_M 4x | 20.8M | 1485 ms | 849 ms | 598 ms (107 FPS) | 2428 MB |
|
| 319 |
|
|
|
|
|
|
|
| 320 |
**Verdict.** At a 256px tile HEART is **~1.8x faster than HAT_M** in PyTorch and
|
| 321 |
uses **~3.6x less VRAM** (679 MB vs 2.4 GB) — a bigger margin than our earlier
|
| 322 |
30k-iteration note suggested. Under **TensorRT** both get dramatically faster,
|
|
|
|
| 34 |
real-world usable first, not benchmark-chasing. See
|
| 35 |
[Relation to NERVE](#relation-to-nerve) for which one to pick.
|
| 36 |
|
| 37 |
+
All HEART models were trained on a single consumer GPU (**RTX 3060, 12 GB**) — this network trains and runs on ordinary consumer hardware, no server-class GPU required.
|
| 38 |
+
|
| 39 |
+
**NERVE links:** [models & configs](https://huggingface.co/Phips/NERVE) · [try it online (ZeroGPU)](https://huggingface.co/spaces/Phips/nerve) · [convert a checkpoint](https://huggingface.co/spaces/Phips/nerve-convert) · [local app](https://github.com/Phhofm/nerve-app) · [train your own (Colab)](https://github.com/Phhofm/nerve-train)
|
| 40 |
+
|
| 41 |
> Short version: copy `heart_arch.py` into traiNNer-redux, train with
|
| 42 |
> `lq_size: 96`, export to ONNX, run it (ONNX Runtime verified). Details below.
|
| 43 |
|
|
|
|
| 321 |
| HEART 4x OTF GAN | 16.7M | 809 ms | 753 ms | **270 ms** | 679 MB |
|
| 322 |
| HAT_M 4x | 20.8M | 1485 ms | 849 ms | 598 ms (107 FPS) | 2428 MB |
|
| 323 |
|
| 324 |
+

|
| 325 |
+
|
| 326 |
**Verdict.** At a 256px tile HEART is **~1.8x faster than HAT_M** in PyTorch and
|
| 327 |
uses **~3.6x less VRAM** (679 MB vs 2.4 GB) — a bigger margin than our earlier
|
| 328 |
30k-iteration note suggested. Under **TensorRT** both get dramatically faster,
|