/
Lucene Reindex

Lucene Reindex

Apr 06, 2015

Overview

This page documents the use of admin tools to rebuild the Lucene index.  Indexes are created based on the hibernate-search annotations on model objects such as @Indexed, @IndexedEmbedded, @Field, @ContainedIn, etc.

Prerequisites

  • MySQL database must already exist (e.g. "tsdb").  

    • If no data exists in the database, this tool will clear the indexes.

    • Otherwise, it will index the available data.

  • MySQL database connection parameters must be defined in the properties file specified by "run.config.ts".

  • The file system directory specified by the "hibernate.search.default.indexBase" in the properties file specified by run.config.ts must exist.

Details

This tool is used to rebuild Lucene indexes for objects indexed by the system.

Indexes are written into the directory specified by the hibernate.search.default.indexBase property in the properties file specified by "run.config.ts".

Following are some details about the implementation of this tool:

Mojo: LuceneReindexMojo.java (in admin/mojo/src/main/resources/java/org/ihtsdo/otf/ts/mojo)

Project: admin/lucene

Configuration Parameters

  • run.config.ts - the standard configuration file specified as a -D parameter

  • indexed.objects - optional parameter that allows a comma-separated list of objects to reindex (e.g. MapRecordJpa).  If omitted, all indexes are rebuilt.

  • server - true/false indicating whether to run the mojo through the server 

Samples

Sample command line call of the admin tool to rebuild all indexes:

 

% cd ~/code/admin/lucene

% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties

 

Sample command line call of the admin tool to rebuild all indexes via a REST call to the server (here the run.config.ts is used to specify the base.url parameter, which is where the server is running):

 

% cd ~/code/admin/lucene

% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties -Dserver=true

 

 

Sample command line call of the admin tool to reindex only certain data types:

 

# Re-indexes only map records and tracking records

% cd ~/code/admin/lucene

% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties -Dindexed.objects=ConceptJpa

 

Sample eclipse run configuration to rebuild all indexes:

Troubleshooting

Occasionally it is necessary to completely reindex all objects from scratch. When this is needed, the recommended approach is to remove the index files from the index and then run this mojo. For example:

 

# stop the server

% service tomcat7 stop

 

# remove the index

% /bin/rm -rf /var/lib/tomcat7/indexes/*ConceptJpa

 

# rebuild the index

% cd ~/code/admin/lucene

% mvn install -PReindex  -Drun.config.ts=/home/ec2-tomcat/config/config.properties -Dindexed.objects=ConceptJpa

 

# start the server

% service tomcat7 start

 

References/Links