2026 - 04 - 13pagefind-japanese-tokenizer
Pagefind Japanese Search Deep Dive: Tokenizers and IME Fixes
Why searching "サイバー" (cyber) in Pagefind returns "サイドバー" (sidebar) -- digging into the tokenizer mismatch between the index side (lindera/IPAdic) and query side (Intl.Segmenter), plus fixing IME input issues.