How to use darioooooo0o/ctxprune-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="darioooooo0o/ctxprune-small")
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("darioooooo0o/ctxprune-small") model = AutoModelForTokenClassification.from_pretrained("darioooooo0o/ctxprune-small", device_map="auto")
How to use darioooooo0o/ctxprune-small with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('token-classification', 'darioooooo0o/ctxprune-small');
