Download special_tokens_map.json from flexitok/mod-tokenizers-ltr_4digit: direct link, hf CLI and curl.
- Browser
- Download file 162 Bytes
-
https://huggingface.co/flexitok/mod-tokenizers-ltr_4digit/resolve/main/special_tokens_map.json
- Command line
-
hf download hf://flexitok/mod-tokenizers-ltr_4digit/special_tokens_map.json
-
curl -L -o special_tokens_map.json https://huggingface.co/flexitok/mod-tokenizers-ltr_4digit/resolve/main/special_tokens_map.json
162 Bytes
| { | |
| "additional_special_tokens": [ | |
| "mod", | |
| "=", | |
| " " | |
| ], | |
| "bos_token": "<s>", | |
| "eos_token": "</s>", | |
| "pad_token": "<pad>", | |
| "unk_token": "<unk>" | |
| } | |