haeing commited on
Commit
f20023b
·
verified ·
1 Parent(s): 3f90d0b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +49 -0
README.md ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - robotics
5
+ - 3d-reconstruction
6
+ - shape-completion
7
+ - point-cloud
8
+ - perception-for-manipulation
9
+ library_name: gapseg
10
+ ---
11
+
12
+ # GapSeg — Diagnosis-Gated Learned Shape Completion
13
+
14
+ Single RGB-D → per-object **distortion diagnosis** → gated **learned completion** →
15
+ full 3D shape + dimensions. A single view of an object gives a broken 3D shape;
16
+ this pipeline predicts which objects are distorted and completes only those with a
17
+ learned network, beating geometric multi-view fusion.
18
+
19
+ ## Results (GraspNet, 140 objects, chamfer mm ↓)
20
+
21
+ | method | chamfer | vs single |
22
+ |---------------|--------:|----------:|
23
+ | single view | 6.40 | — |
24
+ | geometric fusion | 5.44 | 88% (sig) |
25
+ | **single + completion** | **2.99** | 92% (sig) |
26
+ | **diagnosis-gated completion** | **3.12** | 91% (sig) |
27
+
28
+ Learned completion of a single view beats multi-view geometric fusion; gating it
29
+ by the diagnoser keeps the gain while only completing hard objects.
30
+
31
+ ## Usage
32
+
33
+ ```python
34
+ from gapseg.pipeline import GapSegPipeline
35
+ pipe = GapSegPipeline.from_pretrained("haeing/gapseg", device="cuda")
36
+
37
+ # rgb: HxWx3 uint8, depth_m: HxW float (metres), K: 3x3
38
+ # instances: [{"inst_id": 1, "mask": HxW bool, "R": 3x3, "t": (3,)}, ...]
39
+ out = pipe.infer(rgb, depth_m, K, instances)
40
+ for o in out:
41
+ print(o["inst_id"], o["dims_cm"], "completed:", o["completed"])
42
+ ```
43
+
44
+ `R`/`t` (object pose) drive completion; objects without a pose or below the
45
+ diagnosis threshold return their single-view cloud.
46
+
47
+ ## Contents
48
+ - `sq2_gview/best.pt` — the G_view diagnoser (RGB-D → distortion / conditions)
49
+ - `sq3_completion/best.pt` — the PCN shape-completion network