Compact Math & Language Models
Collection
Lightweight Transformer checkpoints for symbolic 1D linear algebra (T5) and compact causal language modeling (Pythia-70M). โข 2 items โข Updated
How to use entity2260/algebra_linear_1d with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("entity2260/algebra_linear_1d")
model = AutoModelForSeq2SeqLM.from_pretrained("entity2260/algebra_linear_1d", device_map="auto")This is a t5-small fine-tuned version on the math_dataset/algebra_linear_1d for solving algebra 1d equations mission.
To load the model: (necessary packages: !pip install transformers sentencepiece)
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("entity2260/algebra_linear_1d")
model = AutoModelForSeq2SeqLM.from_pretrained("entity2260/algebra_linear_1d")
You can then use this model to solve algebra 1d equations into numbers.
query = "Solve 0 = 1026*x - 2474 + 46592 for x"
input_text = f"{query} </s>"
features = tokenizer([input_text], return_tensors='pt')
model.to('cuda')
output = model.generate(input_ids=features['input_ids'].cuda(),
attention_mask=features['attention_mask'].cuda())
tokenizer.decode(output[0])
# <pad> -41</s>
Another examples:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("entity2260/algebra_linear_1d") model = AutoModelForSeq2SeqLM.from_pretrained("entity2260/algebra_linear_1d", device_map="auto")