File size: 1,434 Bytes
b2be135 e72f0d1 b2be135 e72f0d1 b2be135 e72f0d1 b2be135 e72f0d1 b2be135 e72f0d1 b2be135 e72f0d1 b2be135 e72f0d1 b2be135 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | ---
library_name: transformers
tags:
- image-segmentation
- pathology
- dpt
pipeline_tag: image-segmentation
---
# Lung structures Segmentation (DPT)
Pathology segmentation for lung structures (blood vessels and airways).
- Encoder (freezed): H-optimus-0 ViT backbone (pretrained on histopathology data).
- Decoder (trained): custom DPT head with multi-scale feature fusion.
## Usage
The model expects a normalized `(B, 3, H, W)` float tensor as `pixel_values`.
Use ImageNet mean/std — same stats applied at training time (matches the
H-optimus-0 backbone's expected input distribution).
Input image: 224x224 @ 1.5 MPP
```python
import numpy as np
import torch
from PIL import Image
from torchvision.transforms import ToTensor, Normalize, Resize, Compose
from transformers import AutoModel
model = AutoModel.from_pretrained("RendeiroLab/MetPredict-lung-structure-segmentation", trust_remote_code=True).eval()
device = next(model.parameters()).device
transform = Compose([
ToTensor(),
Resize((224, 224)),
Normalize(
mean=[0.485, 0.456, 0.406],
std=[0.229, 0.224, 0.225]
),
])
img = Image.open("tile.png").convert("RGB")
x = transform(img)
pixel_values = x.unsqueeze(0).to(device)
with torch.inference_mode():
out = model(pixel_values)
logits = out.logits # (1, n_classes, H, W)
pred = logits.argmax(dim=1) # (1, H, W)
```
|