How to use AnkitAI/TinyJev-4B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="AnkitAI/TinyJev-4B")
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("AnkitAI/TinyJev-4B") model = AutoModel.from_pretrained("AnkitAI/TinyJev-4B", device_map="auto")
How to use AnkitAI/TinyJev-4B with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir TinyJev-4B AnkitAI/TinyJev-4B
