Duplicated from AlexWortega/openjev
How to use ldov/openjevv with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="ldov/openjevv")
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ldov/openjevv", device_map="auto")
e46c127
1
2
3
"""SGLang external model package for openjev. Enable with SGLANG_EXTERNAL_MODEL_PACKAGE=sglang_openjev (this directory's parent must be on PYTHONPATH); see serve_sglang.sh."""
