Feature Extraction
Transformers
Safetensors
English
lessvit
hyperspectral
remote-sensing
geospatial
vision-transformer
custom_code
Instructions to use GFM-Bench/LESSViT-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use GFM-Bench/LESSViT-Base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="GFM-Bench/LESSViT-Base", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("GFM-Bench/LESSViT-Base", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Use public model name LESSViT-Base in documentation and examples
Browse files- README.md +3 -3
- SHA256SUMS +2 -2
- load_encoder.py +2 -2
README.md
CHANGED
|
@@ -12,7 +12,7 @@ tags:
|
|
| 12 |
arxiv: 2605.18541
|
| 13 |
---
|
| 14 |
|
| 15 |
-
# LESSViT-
|
| 16 |
|
| 17 |
Pretrained **LESSViT** encoder for hyperspectral representation learning, exported
|
| 18 |
from the `LESSVIT_b2_d8_r1` checkpoint. The root of this repository contains an
|
|
@@ -43,7 +43,7 @@ import torch
|
|
| 43 |
from transformers import AutoModel
|
| 44 |
|
| 45 |
encoder = AutoModel.from_pretrained(
|
| 46 |
-
"GFM-Bench/LESSViT-
|
| 47 |
trust_remote_code=True,
|
| 48 |
).eval()
|
| 49 |
|
|
@@ -71,7 +71,7 @@ band_patch_features = features[:, 1:, 1:] # [1, 10, 4, 768]
|
|
| 71 |
`load_encoder.py` contains the same runnable example:
|
| 72 |
|
| 73 |
```bash
|
| 74 |
-
python load_encoder.py --model-id GFM-Bench/LESSViT-
|
| 75 |
```
|
| 76 |
|
| 77 |
To run offline after downloading a complete snapshot, pass its directory as
|
|
|
|
| 12 |
arxiv: 2605.18541
|
| 13 |
---
|
| 14 |
|
| 15 |
+
# LESSViT-Base
|
| 16 |
|
| 17 |
Pretrained **LESSViT** encoder for hyperspectral representation learning, exported
|
| 18 |
from the `LESSVIT_b2_d8_r1` checkpoint. The root of this repository contains an
|
|
|
|
| 43 |
from transformers import AutoModel
|
| 44 |
|
| 45 |
encoder = AutoModel.from_pretrained(
|
| 46 |
+
"GFM-Bench/LESSViT-Base",
|
| 47 |
trust_remote_code=True,
|
| 48 |
).eval()
|
| 49 |
|
|
|
|
| 71 |
`load_encoder.py` contains the same runnable example:
|
| 72 |
|
| 73 |
```bash
|
| 74 |
+
python load_encoder.py --model-id GFM-Bench/LESSViT-Base --device cpu
|
| 75 |
```
|
| 76 |
|
| 77 |
To run offline after downloading a complete snapshot, pass its directory as
|
SHA256SUMS
CHANGED
|
@@ -1,8 +1,8 @@
|
|
| 1 |
-
|
| 2 |
d6fcf9ed303752ba5ea7792d3fa00e16ac35cd561b6df23e5a19f4d219be6aac attention_ops.py
|
| 3 |
5aee6c840ac260cde0131ba16ac4c637da27cbe63f94aa0cd5d72f6171436e5d config.json
|
| 4 |
0e049d15e1a8229824e4b87f0d3312f55e58c0a2985bd36a69fa5f7790d024de hyperspectral_patch_embed.py
|
| 5 |
-
|
| 6 |
e1e7af883a62f663010397bc46fcae04801ed2465ed830e8bb488a044f05f809 low_rank_attention.py
|
| 7 |
935719728265cf0765b32afe634803ab73071025f104c1c708b98142488b8311 model.safetensors
|
| 8 |
1b29142386ee2d45deb01325fdf7cc63e91fd1503ca1017ac0d47db9341e3111 modeling_lessvit.py
|
|
|
|
| 1 |
+
a10bcd03f32b2dd16557b340dfe7ed2bab268a51d45488bc240c077de3710e29 README.md
|
| 2 |
d6fcf9ed303752ba5ea7792d3fa00e16ac35cd561b6df23e5a19f4d219be6aac attention_ops.py
|
| 3 |
5aee6c840ac260cde0131ba16ac4c637da27cbe63f94aa0cd5d72f6171436e5d config.json
|
| 4 |
0e049d15e1a8229824e4b87f0d3312f55e58c0a2985bd36a69fa5f7790d024de hyperspectral_patch_embed.py
|
| 5 |
+
18968c3e096b908457b47fb35c387609c0e55ac31e9123d4c6e3d6e94fd00019 load_encoder.py
|
| 6 |
e1e7af883a62f663010397bc46fcae04801ed2465ed830e8bb488a044f05f809 low_rank_attention.py
|
| 7 |
935719728265cf0765b32afe634803ab73071025f104c1c708b98142488b8311 model.safetensors
|
| 8 |
1b29142386ee2d45deb01325fdf7cc63e91fd1503ca1017ac0d47db9341e3111 modeling_lessvit.py
|
load_encoder.py
CHANGED
|
@@ -4,7 +4,7 @@ import torch
|
|
| 4 |
from transformers import AutoModel
|
| 5 |
|
| 6 |
|
| 7 |
-
def load_encoder(model_id="GFM-Bench/LESSViT-
|
| 8 |
model = AutoModel.from_pretrained(
|
| 9 |
model_id, trust_remote_code=True, revision=revision,
|
| 10 |
)
|
|
@@ -13,7 +13,7 @@ def load_encoder(model_id="GFM-Bench/LESSViT-b2-d8-r1", device="cpu", revision=N
|
|
| 13 |
|
| 14 |
def main():
|
| 15 |
parser = argparse.ArgumentParser(description=__doc__)
|
| 16 |
-
parser.add_argument('--model-id', default='GFM-Bench/LESSViT-
|
| 17 |
help='Hugging Face model ID or local snapshot directory')
|
| 18 |
parser.add_argument('--revision', default=None, help='Optional commit SHA')
|
| 19 |
parser.add_argument('--device', default='cpu')
|
|
|
|
| 4 |
from transformers import AutoModel
|
| 5 |
|
| 6 |
|
| 7 |
+
def load_encoder(model_id="GFM-Bench/LESSViT-Base", device="cpu", revision=None):
|
| 8 |
model = AutoModel.from_pretrained(
|
| 9 |
model_id, trust_remote_code=True, revision=revision,
|
| 10 |
)
|
|
|
|
| 13 |
|
| 14 |
def main():
|
| 15 |
parser = argparse.ArgumentParser(description=__doc__)
|
| 16 |
+
parser.add_argument('--model-id', default='GFM-Bench/LESSViT-Base',
|
| 17 |
help='Hugging Face model ID or local snapshot directory')
|
| 18 |
parser.add_argument('--revision', default=None, help='Optional commit SHA')
|
| 19 |
parser.add_argument('--device', default='cpu')
|