Subword Tokenization (BPE, WordPiece) — Roadmap Step & Resources

Splitting text into subword units to handle rare and unknown words gracefully

Open on Cached Info