Instructions to use SchnabelTim/t5-catify-de-en with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SchnabelTim/t5-catify-de-en with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SchnabelTim/t5-catify-de-en")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("SchnabelTim/t5-catify-de-en") model = AutoModelForSeq2SeqLM.from_pretrained("SchnabelTim/t5-catify-de-en", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SchnabelTim/t5-catify-de-en with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SchnabelTim/t5-catify-de-en" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SchnabelTim/t5-catify-de-en", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/SchnabelTim/t5-catify-de-en
- SGLang
How to use SchnabelTim/t5-catify-de-en with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SchnabelTim/t5-catify-de-en" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SchnabelTim/t5-catify-de-en", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SchnabelTim/t5-catify-de-en" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SchnabelTim/t5-catify-de-en", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use SchnabelTim/t5-catify-de-en with Docker Model Runner:
docker model run hf.co/SchnabelTim/t5-catify-de-en
YAML Metadata Warning:The pipeline tag "text2text-generation" is not in the official list: text-classification, token-classification, table-question-answering, question-answering, zero-shot-classification, translation, summarization, feature-extraction, text-generation, fill-mask, sentence-similarity, text-to-speech, text-to-audio, automatic-speech-recognition, audio-to-audio, audio-classification, audio-text-to-text, voice-activity-detection, depth-estimation, image-classification, object-detection, image-segmentation, text-to-image, image-to-text, image-to-image, image-to-video, unconditional-image-generation, video-classification, reinforcement-learning, robotics, tabular-classification, tabular-regression, tabular-to-text, table-to-text, multiple-choice, text-ranking, text-retrieval, time-series-forecasting, text-to-video, image-text-to-text, image-text-to-image, image-text-to-video, visual-question-answering, document-question-answering, zero-shot-image-classification, graph-ml, mask-generation, zero-shot-object-detection, text-to-3d, image-to-3d, image-feature-extraction, video-text-to-text, keypoint-detection, visual-document-retrieval, any-to-any, video-to-video, other
Model Card for SchnabelTim/t5-catify-de-en
Model Details
- Model Name: SchnabelTim/t5-catify-de-en
- Model Architecture: T5
- Base Model: Einmalumdiewelt/T5-Base_GNAD
- Language(s): German, English
- License: MIT
- Author: SchnabelTim
Model Description
SchnabelTim/t5-catify-de-en is a Transformer-based model fine-tuned from the T5 architecture. It is designed to transform person-related data into cat-related data, functioning effectively in both German and English. The model can take input sentences that are about people and convert them to be about cats, maintaining the original context and meaning as much as possible.
Training Data
The model was trained on a self-created dataset. The dataset includes sentences related to people and their corresponding cat-related transformations. This dataset was curated to ensure diverse and contextually rich examples for robust performance across various scenarios.
Training Procedure
- Number of Epochs: 5
- Batch Size: 12
- Optimizer: AdamW
- Learning Rate: 5e-5
Training was monitored using TensorBoard, and the following metrics were observed:
- Training Loss: 0.098
- Validation Loss: 0.096
Evaluation
The model was evaluated on a held-out test set from the same distribution as the training data. The following metrics were used to assess model performance:
- Test Loss: 0.096
Usage
To use this model, you can load it using the Hugging Face Transformers library as follows:
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("SchnabelTim/t5-catify-de-en")
model = AutoModelForSeq2SeqLM.from_pretrained("SchnabelTim/t5-catify-de-en")
def catify_text(input_text):
inputs = tokenizer(input_text, return_tensors="pt")
outputs = model.generate(**inputs)
return tokenizer.decode(outputs[0], skip_special_tokens=True)
input_text = "What is a Human?"
print(catify_text(input_text)) # Output: "What is a cat?"
- Downloads last month
- 10