Spaces:

lysandre
/

tokenizers-v1-cache

Running

App Files Files Community

tokenizers-v1-cache / README.md

lysandre HF Staff

tokenizers v1 blog figure: cache

9a4e620 verified about 1 month ago

preview code

Raw History Blame Contribute Delete

316 Bytes

---
title: tokenizers v1 word cache
emoji: 🗃️
colorFrom: gray
colorTo: gray
sdk: static
pinned: false
license: apache-2.0
---
A figure from [tokenizers v1](https://huggingface.co/blog/tokenizers-v1), split
out so the blog post can embed it. Generated by `make_embeds.py`; edit the post
source, not this Space.

	---
	title: tokenizers v1 word cache
	emoji: 🗃️
	colorFrom: gray
	colorTo: gray
	sdk: static
	pinned: false
	license: apache-2.0
	---

	A figure from [tokenizers v1](https://huggingface.co/blog/tokenizers-v1), split
	out so the blog post can embed it. Generated by `make_embeds.py`; edit the post
	source, not this Space.