Hugging Face's logo

fhswf
/
tiny-stack-tokenizer

gpt2
Model card Files
xet
 Community
1
tiny-stack-tokenizer

Commit History

  1. switch to tiktoken

    pweb002
    Verified signature
    f668f02

  2. Upload 4 files⁠

    pweb002
    Verified signature
    a148a53

  1. Update config.json

    pweb002
    Verified signature
    f1ffaf5

  2. Using BPE Tokenizer

    Paul Weber
    1227d41

  1. Upload 5 files

    pweb002
    Verified signature
    52b5bec

  1. Fixed special token

    Paul Weber
    be70724

  1. Added code, error_message and description special token

    Paul Weber
    986b051

  1. Changed config

    Paul Weber
    c36d23a

  2. Added config

    Paul Weber
    0a5ebd5

  1. Trained tokenizer for Tiny-Stack dataset

    Paul Weber
    18151ff

  2. initial commit

    pweb002
    Verified signature
    ad96744