Dev.to · Omochi
📰 AI News & Updates
⚡ AI Lesson
2mo ago
Why SQLite FTS5's default tokenizer drops your Japanese substrings (and the one-line fix)
FTS5's unicode61 tokenizer silently fails on CJK substring queries. Switching to trigram tokenization fixes it — here's the whole change, plus the two-layer Git