tokenizers-v1-split / README.md
lysandre's picture
lysandre HF Staff
tokenizers v1 blog figure: split
f08dbf2 verified
|
Raw History Blame Contribute Delete
310 Bytes
metadata
title: tokenizers v1 split
emoji: ✂️
colorFrom: gray
colorTo: gray
sdk: static
pinned: false
license: apache-2.0

A figure from tokenizers v1, split out so the blog post can embed it. Generated by make_embeds.py; edit the post source, not this Space.