README.md

---

pipeline_tag: text-generation
library_name: transformers
language:
  - en
license: fair-noncommercial-research-license
datasets:
  - malte0621/test-dataset
---

# Test Model
This is a model created for testing purposes. It is one of the smallest models available on Hugging Face, designed to experiment with the capabilities of small/tiny models.

## Model Structure
The model is structured to handle text generation tasks. It is trained on a small dataset that consists of user prompts and AI responses, allowing it to generate text based on given inputs.

## Usage
You can use this model for text generation tasks, particularly for testing and experimentation with small models. It is not intended for production use or serious applications.

### Prompt format
```

<|user|>Your input prompt here<|ai|>The model's response will be generated here<|stop|>

```

### Example Usage


#### Transformers
```python

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "Malte0621/test-model"

model = AutoModelForCausalLM.from_pretrained(model_name, gguf_file="model.gguf")

tokenizer = AutoTokenizer.from_pretrained(model_name)

prompt = "<|user|>Hi there!<|ai|>"

response = model.generate(tokenizer(prompt, return_tensors="pt").input_ids)

print(tokenizer.decode(response[0], skip_special_tokens=True))

```

#### llama.cpp
```bash

./llama-cli -m model.gguf -p "<|user|>Hi there!<|ai|>" -n 128 -no-cnv --rope-freq-scale 0.125

```

#### LM Studio
https://model.lmstudio.ai/download/Malte0621/test
**(Make sure to set the RoPE frequency scale to 0.125 in the model settings.)**

## License
This model is released under the [Fair Noncommercial Research License](https://huggingface.co/Malte0621/test/blob/main/LICENSE).

## Citation
If you use this model in your research, please cite it as follows:
```

@misc{test-model,

  author = {Malte0621},

  title = {Test-Model},

  year = {2025},

  url = {https://huggingface.co/Malte0621/test}

}

```

## Acknowledgements
This model was created as part of a personal project to explore the capabilities of small language models. It is not affiliated with any organization or commercial entity.