xzy-jason/dsh-chinese-search

README excerpt

dsh-chinese-search Chinese full-text search plugin for DeepSeek Harness memory plugins. Problem SQLite FTS5's default unicode61 tokenizer splits text by whitespace, which completely fails for Chinese (no word boundaries): Solution Uses jieba (Rust-based, no native build) for proper Chinese word segmentation: Installation Usage With memory plugins Works automatically with sage-mem, dsh-memory, and other memory plugins. Just install and it enhances search: Programmatic API Benchmark Tested with 10,000 Chinese memory entries: Method Recall Precision Latency unicode61 (default) 0% N/A 1ms trigram + LIKE 78% 45% 12ms jieba FTS5 (this plugin) 97% 94% 3ms How it works 1. Tokenization : jieba segments Chinese text into words 2. Dual index : FTS5 for English + jieba token table for Chinese 3. Hybrid search : Combines results from both indexes 4. Scoring : Ranks by term frequency and match coverage 5. Fallback : LIKE query for partial/fuzzy matches Configuration License MIT

Category