Subword Tokenization — Study Resources & PYQs
Curated resources, past papers and PYQs for Subword Tokenization.
Study resources
- Summary of the tokenizers (Article) — The official Hugging Face documentation explaining BPE and other subword tokenization schemes.
- Byte Pair Encoding Tokenization Explained (Video) — A practical explanation of how subword tokenization handles rare and unknown words.