期刊论文

Place name database quick searching system based on Lucene

中文

计算机应用研究

1001-3695

2017

34

6

1756-1761

10.3969/j.issn.1001-3695.2017.06.034

国家科技支撑计划资助项目（2012BAH83F00）；

本校为第一机构

针对传统关系型数据库海量地名数据检索效率低下的问题,提出了一种盘古分词和Lucene全文检索相结合的地名数据库快速检索方法。首先,设计了一种地名数据表结构,比较了几种常用开源分词器的中文分词性能,并选用性能优异的盘古中文分词器,通过扩展其词典来实现中文地名的有效分词。其次,利用内存索引和多线程并行处理技术提高Lucene创建倒排索引效率,并依据地名类别和显示优先级属性优化了检索结果相关度排序策略。最后,开发了一套具有快速搜索和地图定位展示的Web地名检索系统,使用500万条真实地名数据测试了其检索性能,查询平均耗时不到1 s,比MySQL数据库模糊检索效率提高了15倍,匹配结果也更加...

To avoid the low efficiency in massive place names searching in the traditional relational database, this paper proposed a fast place name database retrieval method with the integration of PanGuAnalyzer and Lucene full-text search toolbox. Firstly, it designed a place name data structure, and compared the segmentation performances of several open source Chinese analyzers. Based on the results, it integrated the excellent PanguAnalyzer with a rich place dictionary into Lucene so as to improve the effect of Chinese place name segmentation. To improve the efficiency of creating inverted index, it...