| --- |
| tags: |
| - llama |
| - alpaca |
| - vicuna |
| - uncensored |
| - cot |
| - chain of thought |
| - story |
| - adventure |
| - roleplay |
| - rp |
| - merge |
| - mix |
| - instruct |
| - wizardlm |
| - superhot |
| - supercot |
| - manticore |
| - hippogriff |
| --- |
| |
| ## 30B-Epsilon |
|
|
| Epsilon is an instruct based general purpose model assembled from hand picked models and LoRAs. |
| There is no censorship and it follows instructions in the Alpaca format. This means you can create |
| your own rules in the context memory of your inference system of choice [mainly KoboldAI or Text |
| Generation Webui and chat UIs like SillyTavern and so on]. |
|
|
| ## Composition: |
|
|
| This model is the result of an experimental use of LoRAs on language models and model merges. |
| [] = applied as LoRA to a composite model | () = combined as composite models |
| 30B-Epsilon = [SuperCOT[SuperHOT-prototype13b-8192[(wizardlmuncensored+((hippogriff+manticore)+(StoryV2))] |
|
|
| Alpaca's instruct format can be used to do many things, including control of the terms of behavior |
| between a user and a response from an agent in chat. Below is an example of a command injected into |
| memory. |
|
|
| ``` |
| ### Instruction: |
| Make Narrator function as a text based adventure game that responds with verbose, detailed, and creative descriptions of what happens next after Player's response. |
| Make Player function as the player input for Narrator's text based adventure game, controlling a character named (insert character name here, their short bio, and |
| whatever quest or other information to keep consistent in the interaction). |
| |
| ### Response: |
| {an empty new line here} |
| ``` |
|
|
| All datasets from all models and LoRAs used were documented and reviewed as model candidates for merging. |
| Model candidates were based on five core principles: creativity, logic, inference, instruction following, |
| and longevity of trained responses. SuperHOT-prototype30b-8192 was used in this mix, not the 8K version; |
| the prototype LoRA seems to have been removed [from HF] as of this writing. The GPT4Alpaca LoRA from |
| Chansung was removed from this amalgam following a thorough review of where censorship and railroading |
| the user came from in 33B-Lazarus. This is not a reflection of ChanSung's excellent work - it merely did |
| not fit the purpose of this model. |
|
|
| ## Language Models and LoRAs Used Credits: |
|
|
| manticore-30b-chat-pyg-alpha [Epoch0.4] by openaccess-ai-collective |
|
|
| https://huggingface.co/openaccess-ai-collective/manticore-30b-chat-pyg-alpha |
|
|
| hippogriff-30b-chat by openaccess-ai-collective |
|
|
| https://huggingface.co/openaccess-ai-collective/hippogriff-30b-chat |
|
|
| WizardLM-33B-V1.0-Uncensored by ehartford |
|
|
| https://huggingface.co/ehartford/WizardLM-33B-V1.0-Uncensored |
|
|
| Storytelling-LLaMa-LoRA [30B, Version 2] by GamerUnTouch |
|
|
| https://huggingface.co/GamerUntouch/Storytelling-LLaMa-LoRAs |
|
|
| SuperCOT-LoRA [30B] by kaiokendev |
|
|
| https://huggingface.co/kaiokendev/SuperCOT-LoRA |
|
|
| SuperHOT-LoRA-prototype30b-8192 [30b, not 8K version, but a removed prototype] by kaiokendev |
|
|
| https://huggingface.co/kaiokendev/superhot-30b-8k-no-rlhf-test [Similar LoRA to one since removed that was used in making this model.] |
|
|
| Also thanks to Meta for LLaMA and to each and every one of you |
| who developed these fine-tunes and LoRAs. |
