This crate is a rust porting of Andrej Karpathy implementation of BPE algorithm available here https://github.com/karpathy/minbpe.
anperrone/minbpe
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
| Name | Name | Last commit date | ||
|---|---|---|---|---|
This crate is a rust porting of Andrej Karpathy implementation of BPE algorithm available here https://github.com/karpathy/minbpe.