--- title: T emoji: 🏃 colorFrom: purple colorTo: gray sdk: docker pinned: false license: mit --- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference https://github.com/HumanSignal/label-studio-ml-backend/assets/106922533/d1d2f233-d7c0-40ac-ba6f-368c3c01fd36 # Grounding DINO backend integration with SAM enabled This integration will allow you to: * Use text prompts for zero-shot detection of objects in images. * Specify the detection of any object and get state-of-the-art results without any model fine tuning. * Get segmentation predictions from SAM with just text prompts. See [here](https://github.com/IDEA-Research/GroundingDINO) for more details about the pre-trained Grounding DINO model. ## Before you begin Before you begin, you must install the [Label Studio ML backend](https://github.com/HumanSignal/label-studio-ml-backend?tab=readme-ov-file#quickstart). This tutorial uses the [`grounding_sam` example](https://github.com/HumanSignal/label-studio-ml-backend/tree/master/label_studio_ml/examples/grounding_sam). ## Quickstart 1. Make sure Docker is installed. 2. Edit `docker-compose.yml` to include the following: * `LABEL_STUDIO_HOST` sets the endpoint of the Label Studio host. Must begin with `http://` * `LABEL_STUDIO_ACCESS_TOKEN` sets the API access token for the Label Studio host. This can be found by logging into Label Studio and [going to the **Account & Settings** page](https://labelstud.io/guide/user_account#Access-token). Example: - `LABEL_STUDIO_HOST=http://123.456.7.8:8080` - `LABEL_STUDIO_ACCESS_TOKEN=your-api-key` 3. Run `docker compose up` 4. Check the IP of your backend using `docker ps`. You will use this URL when connecting the backend to a Label Studio project. Usually this is `http://localhost:9090`. 5. Create a project and edit the labeling config (an example is provided below). When editing the labeling config, make sure to add all rectangle labels under the `RectangleLabels` tag, and all corresponding brush labels under the `BrushLabels` tag. ```xml