| license: mit | |
| language: | |
| - en | |
| tags: | |
| - text-generation-inference | |
| ## GPT-MUD | |
| GPT-MUD is a lightweight, 47-million-parameter LLM designed to play NPC characters in games. | |
| Trained using the ClubFloyd corpus, an MUD-like dataset. | |
| ## Technical Information | |
| | | | | |
| |---------------------------------|----:| | |
| |Layers |6| | |
| |Heads |4| | |
| |Embeddings |256| | |
| |Context Window |65536 tokens| | |
| |Tokenizer |cl100k_base| |