Jul 18, 2024 22:42 Do not add eos token by default (#8 ) - Do not add eos token by default (6d762032ac7adbc536dd25d458a13b59454b24cb)
- Update .gitattributes (1230593151b8a1e8f3de1f18958236404ed9b21c)
- Upload tokenizer.json (fdc0b188cb40e0a2e60574fce18079145c51e434)
Co-authored-by: Joshua <Xenova@users.noreply.huggingface.co> 12:58 Make HF-compatible (#1 ) - Upload HF tokenizer (204b4d8969d6a4b604ff6fa675c8afbf3a10e7aa)
- Delete README.md (ed60d097feb24818fc8270aa71ae5a7e478c321d)
- Upload HF tokenizer (bc687f214a00a200bbeb248ec4d7c0ffcf16ce26)
- Delete added_tokens.json (df2b4ae0dd25a231360784e56d4b6ac7851beb6c)
- Delete special_tokens_map.json (273ec1aaf8eaa36253597728be611058e99bd297)
- Upload HF tokenizer (86cbe7703be475ee5e01f6edffb3b66ea616558a)
- Upload HF tokenizer (80601a69475ec8ceefa75e478cfe774642dfa13a)
- Create config.json (8c19385240eddcfd519654c6e395286b34e13afa)
- Create generation_config.json (72f172979c1851a4c84d21fae650215b8aedaf43)
- Upload HF-compatible model (74407c6da6768e3788cbffb1a9df903120918d23)
Co-authored-by: Joshua <Xenova@users.noreply.huggingface.co> 
