ShawnX98 commited on
Commit
14b3bea
·
verified ·
1 Parent(s): f717af8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -3
README.md CHANGED
@@ -1,7 +1,68 @@
1
  ---
2
- license: apache-2.0
 
 
 
 
 
 
 
3
  ---
4
 
5
- Public LeanGate checkpoint.
 
 
 
 
 
6
 
7
- Filename: `leangate.pt`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: mit
3
+ tags:
4
+ - slam
5
+ - monocular-slam
6
+ - visual-localization
7
+ - geometric-foundation-models
8
+ - pytorch
9
+ thumbnail: ./teaser.png
10
  ---
11
 
12
+ <p align="center">
13
+ <h1 align="center">LeanGate</h1>
14
+ <p align="center">
15
+ Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring
16
+ </p>
17
+ </p>
18
 
19
+ <p align="center">
20
+ <a href="https://lean-gate.github.io/">Project Page</a> |
21
+ <a href="https://github.com/XinmiaoShawn/LeanGate-code">Code</a> |
22
+ <a href="#">Paper Coming Soon</a>
23
+ </p>
24
+
25
+ <p align="center">
26
+ <img src="./teaser.png" width="95%">
27
+ </p>
28
+
29
+ ## Overview
30
+
31
+ LeanGate is a lightweight frame-gating model for transformer-based monocular SLAM.
32
+ It predicts the geometric utility of an incoming frame before expensive dense reconstruction,
33
+ allowing the system to skip redundant frames early and significantly reduce computation.
34
+
35
+ ## Highlights
36
+
37
+ - Filters out more than 90% of redundant frames before heavy SLAM processing
38
+ - Reduces tracking FLOPs by more than 85%
39
+ - Achieves around 5x end-to-end throughput speedup
40
+ - Maintains competitive tracking and mapping accuracy
41
+
42
+ ## Model
43
+
44
+ - Checkpoint: `model.pt`
45
+ - Framework: PyTorch
46
+ - Task: frame utility scoring for monocular SLAM
47
+ - Input: current frame and reference/keyframe features or paired image representation
48
+ - Output: geometric utility score used for frame gating
49
+
50
+ ## Qualitative Results
51
+
52
+ <p align="center">
53
+ <img src="./qualitative_2x3_ieee.png" width="95%">
54
+ </p>
55
+
56
+ ## Method
57
+
58
+ <p align="center">
59
+ <img src="./system.png" width="95%">
60
+ </p>
61
+
62
+ ## Quick Start
63
+
64
+ ```python
65
+ import torch
66
+
67
+ ckpt = torch.load("model.pt", map_location="cpu")
68
+ print(type(ckpt))