Hugging Face's logo

RyeAI
/
DA-BPE-LLAMA3.2

Text Generation
Transformers
Safetensors
llama
Danish
BPE Tokenization
LLaMA
text-generation-inference
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="RyeAI/DA-BPE-LLAMA3.2")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("RyeAI/DA-BPE-LLAMA3.2")
model = AutoModelForCausalLM.from_pretrained("RyeAI/DA-BPE-LLAMA3.2", device_map="auto")
Quick Links

DA-BPE-LLAMA3.2

Built on the LLaMA-3.2 architecture, this model uses a standard Byte-Pair-Encoding (BPE) tokenizer optimized for Danish. It serves as a baseline for evaluating the performance of subword tokenization.

Downloads last month
10
Safetensors
Model size
1B params
Tensor type
F16
·
Inference Providers NEW
Text Generation
Examples

Collection including RyeAI/DA-BPE-LLAMA3.2