Spaces:
Sleeping
Sleeping
Commit History
-
perf: Tune batch sizes and queues for A10 GPUs
Zhen Ye- Increased YOLO (HF/Drone) batch size to 32 - Increased Depth Anything batch size to 16 - Increased SAM3 batch size to 8 - Increased DETR batch size to 8 - Expanded inference.py queue_out to handle 32-frame batch burstsa5f8d15
-
Implement Batch Inference & Queue Backpressure Fixes
Zhen Ye5c36daa
-
feat(inference): enable full multi-GPU support for all models
Zhen Ye- Update inference.py to parallelize detection, segmentation, and depth estimation across all available GPUs - Update detectors (YOLOv8, DETR, GroundingDINO, DroneYolo) to accept device argument - Update SAM3 and DepthAnythingV2 to accept device argument - Add device-specific model loading to all model loaders - Remove OwlV2 support45eb65b
-
added depth view
Zhen Ye5e832fe
-
using depth model form transformers
Zhen Ye012b29b -
added depth everything v2
Zhen Ye1c4206e
-
fixed shape mismatch
Zhen Ye18ba97a -
added fallback for Nan
Zhen Ye91f3b56 -
using apple depth pro hf
Zhen Ye94c85d4 -
added apple depth pro
Zhen Yeb8fe2b6