Yaphabates commited on
Commit
2ea7180
·
verified ·
1 Parent(s): 1fad4e7

Add vLLM acceleration plugin and update README

Browse files
Files changed (1) hide show
  1. nas_child_vl_vllm/__init__.py +15 -0
nas_child_vl_vllm/__init__.py ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # SPDX-License-Identifier: Apache-2.0
2
+ """NAS-Child-VL vLLM plugin.
3
+
4
+ Import this before using vLLM with NAS-Child-VL models:
5
+
6
+ import nas_child_vl_vllm
7
+ from vllm import LLM
8
+
9
+ llm = LLM(model="/path/to/nas-child-vl-checkpoint",
10
+ trust_remote_code=True, enforce_eager=True)
11
+ """
12
+
13
+ from nas_child_vl_vllm.register import register
14
+
15
+ register()