interfaze-1-lite

Instructions to use suryatmodulus/interfaze-1-lite with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use suryatmodulus/interfaze-1-lite with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="suryatmodulus/interfaze-1-lite", trust_remote_code=True)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("suryatmodulus/interfaze-1-lite", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use suryatmodulus/interfaze-1-lite with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "suryatmodulus/interfaze-1-lite"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "suryatmodulus/interfaze-1-lite",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/suryatmodulus/interfaze-1-lite

SGLang

How to use suryatmodulus/interfaze-1-lite with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "suryatmodulus/interfaze-1-lite" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "suryatmodulus/interfaze-1-lite",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "suryatmodulus/interfaze-1-lite" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "suryatmodulus/interfaze-1-lite",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use suryatmodulus/interfaze-1-lite with Docker Model Runner:
```
docker model run hf.co/suryatmodulus/interfaze-1-lite
```

interfaze-1-lite / layout /inference.yml

suryatmodulus

Duplicate from interfaze-ai/interfaze-1-lite

33c0287 12 days ago

Raw History Blame Contribute Delete

1.92 kB

# interfaze-sha:cf768c00de3d7e96f230323e6057e0cb765a149796d25a241f512c417471c782
mode: paddle
draw_threshold: 0.5
metric: COCO
use_dynamic_shape: false
Global:
  model_name: PP-DocLayout_plus-L
arch: DETR
min_subgraph_size: 3
Preprocess:
- interp: 2
  keep_ratio: false
  target_size:
  - 800
  - 800
  type: Resize
- mean:
  - 0.0
  - 0.0
  - 0.0
  norm_type: none
  std:
  - 1.0
  - 1.0
  - 1.0
  type: NormalizeImage
- type: Permute
label_list:
- paragraph_title
- image
- text
- number
- abstract
- content
- figure_title
- formula
- table
- reference
- doc_title
- footnote
- header
- algorithm
- footer
- seal
- chart
- formula_number
- aside_text
- reference_content
Hpi:
  backend_configs:
    paddle_infer:
      trt_dynamic_shapes: &id001
        im_shape:
        - - 1
          - 2
        - - 1
          - 2
        - - 8
          - 2
        image:
        - - 1
          - 3
          - 800
          - 800
        - - 1
          - 3
          - 800
          - 800
        - - 8
          - 3
          - 800
          - 800
        scale_factor:
        - - 1
          - 2
        - - 1
          - 2
        - - 8
          - 2
      trt_dynamic_shape_input_data:
        im_shape:
        - - 800
          - 800
        - - 800
          - 800
        - - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
          - 800
        scale_factor:
        - - 2
          - 2
        - - 1
          - 1
        - - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
          - 0.67
    tensorrt:
      dynamic_shapes: *id001

	# interfaze-sha:cf768c00de3d7e96f230323e6057e0cb765a149796d25a241f512c417471c782
	mode: paddle
	draw_threshold: 0.5
	metric: COCO
	use_dynamic_shape: false
	Global:
	model_name: PP-DocLayout_plus-L
	arch: DETR
	min_subgraph_size: 3
	Preprocess:
	- interp: 2
	keep_ratio: false
	target_size:
	- 800
	- 800
	type: Resize
	- mean:
	- 0.0
	- 0.0
	- 0.0
	norm_type: none
	std:
	- 1.0
	- 1.0
	- 1.0
	type: NormalizeImage
	- type: Permute
	label_list:
	- paragraph_title
	- image
	- text
	- number
	- abstract
	- content
	- figure_title
	- formula
	- table
	- reference
	- doc_title
	- footnote
	- header
	- algorithm
	- footer
	- seal
	- chart
	- formula_number
	- aside_text
	- reference_content
	Hpi:
	backend_configs:
	paddle_infer:
	trt_dynamic_shapes: &id001
	im_shape:
	- - 1
	- 2
	- - 1
	- 2
	- - 8
	- 2
	image:
	- - 1
	- 3
	- 800
	- 800
	- - 1
	- 3
	- 800
	- 800
	- - 8
	- 3
	- 800
	- 800
	scale_factor:
	- - 1
	- 2
	- - 1
	- 2
	- - 8
	- 2
	trt_dynamic_shape_input_data:
	im_shape:
	- - 800
	- 800
	- - 800
	- 800
	- - 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	- 800
	scale_factor:
	- - 2
	- 2
	- - 1
	- 1
	- - 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	- 0.67
	tensorrt:
	dynamic_shapes: *id001