Spaces:

lysandre
/

tokenizers-v1-split

Running

App Files Files Community

tokenizers-v1-split / README.md

lysandre's picture

lysandre HF Staff

tokenizers v1 blog figure: split

f08dbf2 verified 18 days ago

|

Raw History Blame Contribute Delete

310 Bytes

	---
	title: tokenizers v1 split
	emoji: ✂️
	colorFrom: gray
	colorTo: gray
	sdk: static
	pinned: false
	license: apache-2.0
	---

	A figure from [tokenizers v1](https://huggingface.co/blog/tokenizers-v1), split
	out so the blog post can embed it. Generated by `make_embeds.py`; edit the post
	source, not this Space.