stefan-it's picture
tokenizer: add original and fast versions
c884b84
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
e67f11604132a188f83bf837bc6695641e14be624ffdaa03de6cc7c8a7984795
Pointer size:
131 Bytes
·
Size of remote file:
823 kB
·
Xet backed hash:
236aa429eea2b1fd874bb40cd2b7789eb614cf9c7f36519f1dbb83b08b5d591f

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.