geodesic-research
/

nemotron-base-tokenizer

continued-pretraining

Model card Files Files and versions

nemotron-base-tokenizer / tokenizer.json

Kyle1668's picture

Add nemotron-base-tokenizer (eos=</s>) for Nemotron Base CPT

4743970 verified 6 months ago

History Blame Contribute Delete

17.1 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 32569e44702186b12870b6b1de657b222323b32cad882ab71cf35b8e50e31325
Size of remote file:: 17.1 MB
SHA256:: 623c34567aebb18582765289fbe23d901c62704d6518d71866e0e58db892b5b7

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.