Text Generation
fastText
Toki Pona
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-constructed_auxlang
Instructions to use wikilangs/tok with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- fastText
How to use wikilangs/tok with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("wikilangs/tok", "model.bin")) - Notebooks
- Google Colab
- Kaggle

- Xet hash:
- c8eee384e038c8b825a761087f00e6206a863f8b4b366cb4e0629b5d9fd0930e
- Size of remote file:
- 117 kB
- SHA256:
- 272356ca1f842bdf65705c56c67d42f5ae32911a25ce064044e052f3b652f9be
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.