meomeo / README.md
hgrrg's picture
Update README.md
0f3fb4b verified
|
Raw History Blame Contribute Delete
746 Bytes
---
tags:
- moe
- code
---
![mlem](https://cdn-uploads.huggingface.co/production/uploads/686e3bfc42698961ad2b7ea3/EbXMHh1sA3KVR4nnccQ9J.gif)
Wanna some meos ? Run this
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
state_dict = torch.load("./meomeo/pytorch_model.bin", weights_only=False, map_location="cpu")
# Load from local folder
tokenizer = AutoTokenizer.from_pretrained("./meomeo", local_files_only=True)
model = AutoModelForCausalLM.from_pretrained("./meomeo", local_files_only=True)
# Simple inference
text = "Mèo Méo Meo Mèo Meo"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_length=50)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```