How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="itsdevruba/midad-allam-7b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("itsdevruba/midad-allam-7b")
model = AutoModelForCausalLM.from_pretrained("itsdevruba/midad-allam-7b", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

مداد (Midad) - ALLaM-7B

نموذج مدرّب لتحويل الدروس الدراسية إلى قصص ومغامرات تفاعلية بالفصحى بسياق سعودي، يكون فيها الطالب بطل القصة. تم تطويره ضمن هاكاثون عربثون.

التدريب

طريقة الاستخدام

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = 'itsdevruba/midad-allam-7b'
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, device_map='auto', torch_dtype='auto')

msgs = [{'role': 'user', 'content': 'حوّل درس دورة الماء إلى قصة تفاعلية'}]
x = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors='pt').to(model.device)
out = model.generate(x, max_new_tokens=800, eos_token_id=tok.eos_token_id, pad_token_id=tok.eos_token_id, repetition_penalty=1.1)
print(tok.decode(out[0][x.shape[1]:], skip_special_tokens=True))

ملاحظة: تمرير eos_token_id ضروري لتجنّب تكرار المخرجات.

Downloads last month
141
Safetensors
Model size
7B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for itsdevruba/midad-allam-7b

Finetuned
(29)
this model
Quantizations
2 models