awesome-elasticsearch-analyzer

• 分词算法综述 https://zhuanlan.zhihu.com/p/50444885

系统默认分词器

• standard https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-standard-analyzer.html
• simple https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-simple-analyzer.html
• Whitespace https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-whitespace-analyzer.html
• Stop https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-stop-analyzer.html
• keyword
• pattern https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-pattern-analyzer.html
• language https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-lang-analyzer.html
• snowball
• Custom自定义分词器
• fingerprint https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-fingerprint-analyzer.html

中文分词器

• IKAnalyzer https://github.com/wks/ik-analyzer
• pinyin分词器 https://github.com/medcl/elasticsearch-analysis-pinyin
• 中科院计算所NLPIR http://ictclas.nlpir.org/nlpir/
• ansj分词器 https://github.com/NLPchina/ansj_seg
• 哈工大的LTP https://github.com/HIT-SCIR/ltp
• 清华大学THULAC https://github.com/thunlp/THULAC
• 斯坦福分词器 https://nlp.stanford.edu/software/segmenter.shtml
• Hanlp分词器 https://github.com/hankcs/HanLP
• 结巴中文分词 https://github.com/yanyiwu/cppjieba
• KCWS分词器(字嵌入+Bi-LSTM+CRF) https://github.com/koth/kcws
• ZPar https://github.com/frcchang/zpar/releases
• Mmseg https://github.com/medcl/elasticsearch-analysis-mmseg/releases
• smartcn
• 庖丁解牛 http://pan.baidu.com/s/1eQ88SZS
• sogo在线分词 http://www.sogou.com/labs/webservice/
• word分词 https://github.com/ysc/word
• jcseg分词器 https://code.google.com/archive/p/jcseg/

分词器插件

• Elasticsearch IK分词插件 https://github.com/medcl/elasticsearch-analysis-ik/releases
• Elasticsearch hanlp 分词插件 https://github.com/KennFalcon/elasticsearch-analysis-hanlp