Instructions to use textattack/xlnet-base-cased-CoLA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use textattack/xlnet-base-cased-CoLA with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="textattack/xlnet-base-cased-CoLA")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("textattack/xlnet-base-cased-CoLA")
model = AutoModelForCausalLM.from_pretrained("textattack/xlnet-base-cased-CoLA", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use textattack/xlnet-base-cased-CoLA with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "textattack/xlnet-base-cased-CoLA"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "textattack/xlnet-base-cased-CoLA",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/textattack/xlnet-base-cased-CoLA

SGLang

How to use textattack/xlnet-base-cased-CoLA with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "textattack/xlnet-base-cased-CoLA" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "textattack/xlnet-base-cased-CoLA",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "textattack/xlnet-base-cased-CoLA" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "textattack/xlnet-base-cased-CoLA",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use textattack/xlnet-base-cased-CoLA with Docker Model Runner:
```
docker model run hf.co/textattack/xlnet-base-cased-CoLA
```

xlnet-base-cased-CoLA

Commit History

Jul 6, 2020

16:29
Update log.txt

system HF Staff

00b24d3
16:29
Update spiece.model

system HF Staff

7acdea7
16:29
Update pytorch_model.bin

system HF Staff

18e39fa
16:29
Update README.md

system HF Staff

d428e77
16:29
Update config.json

system HF Staff

48ca40e
16:29
Update special_tokens_map.json

system HF Staff

5b7c0c4
16:29
Update tokenizer_config.json

system HF Staff

d36d7b2
16:29
Update train_args.json

system HF Staff

ea5cf45
16:21
Update log.txt

system HF Staff

44e9cf4
16:21
Update spiece.model

system HF Staff

7edc1cd
16:21
Update config.json

system HF Staff

c12bf91
16:21
Update README.md

system HF Staff

5826d71
16:21
Update special_tokens_map.json

system HF Staff

d9988a2
16:21
Update tokenizer_config.json

system HF Staff

7dfa47e
16:21
Update train_args.json

system HF Staff

94ad3ba
16:17
Update log.txt

system HF Staff

c12bef2
16:17
Update spiece.model

system HF Staff

f9b324d
16:16
Update README.md

system HF Staff

b1558ca
16:16
Update config.json

system HF Staff

a29fadc
16:16
Update special_tokens_map.json

system HF Staff

b785375
16:16
Update tokenizer_config.json

system HF Staff

f122acd
16:16
Update train_args.json

system HF Staff

a71a443
16:14
Update log.txt

system HF Staff

79876e2
16:14
Update spiece.model

system HF Staff

e412457
16:14
Update README.md

system HF Staff

5ce27ae
16:14
Update config.json

system HF Staff

e6513fd
16:14
Update tokenizer_config.json

system HF Staff

2bf8591
16:14
Update special_tokens_map.json

system HF Staff

345abba
16:14
Update train_args.json

system HF Staff

599ca46
16:09
Update log.txt

system HF Staff

5957a88
16:09
Update spiece.model

system HF Staff

8dd659b
16:09
Update README.md

system HF Staff

0fc95d9
16:09
Update config.json

system HF Staff

7a1385b
16:09
Update tokenizer_config.json

system HF Staff

cadf059
16:09
Update special_tokens_map.json

system HF Staff

9c5c9fc
16:09
Update train_args.json

system HF Staff

41d4c34

Jun 9, 2020

16:55
Update config.json

system HF Staff

d91415e
16:55
Update eval_results_cola.txt

system HF Staff

bc63adc
16:55
Update special_tokens_map.json

system HF Staff

8ad8f11
16:55
Update tokenizer_config.json

system HF Staff

1cc5b10
16:55
Update training_args.bin

system HF Staff

fffa299
16:55
Update spiece.model

system HF Staff

40314e2

Jun 8, 2020

14:21
Update config.json

system HF Staff

c547e4e
14:21
Update eval_results_cola.txt

system HF Staff

2508189
14:21
Update special_tokens_map.json

system HF Staff

c4c576e
14:21
Update tokenizer_config.json

system HF Staff

fe1fb3c
14:21
Update spiece.model

system HF Staff

60bec24

Jun 7, 2020

16:06
Update config.json

system HF Staff

8338b04
16:06
Update eval_results_cola.txt

system HF Staff

c0eaee4
16:06
Update special_tokens_map.json

system HF Staff

b056cad

Commit History

Jul 6, 2020

Update log.txt

Update spiece.model

Update pytorch_model.bin

Update README.md

Update config.json

Update special_tokens_map.json

Update tokenizer_config.json

Update train_args.json

Update log.txt

Update spiece.model

Update config.json

Update README.md

Update special_tokens_map.json

Update tokenizer_config.json

Update train_args.json

Update log.txt

Update spiece.model

Update README.md

Update config.json

Update special_tokens_map.json

Update tokenizer_config.json

Update train_args.json

Update log.txt

Update spiece.model

Update README.md

Update config.json

Update tokenizer_config.json

Update special_tokens_map.json

Update train_args.json

Update log.txt

Update spiece.model

Update README.md

Update config.json

Update tokenizer_config.json

Update special_tokens_map.json

Update train_args.json

Jun 9, 2020

Update config.json

Update eval_results_cola.txt

Update special_tokens_map.json

Update tokenizer_config.json

Update training_args.bin

Update spiece.model

Jun 8, 2020

Update config.json

Update eval_results_cola.txt

Update special_tokens_map.json

Update tokenizer_config.json

Update spiece.model

Jun 7, 2020

Update config.json

Update eval_results_cola.txt

Update special_tokens_map.json