Lucene Reindex
- bcarlsen (Unlicensed)
Overview
This page documents the use of admin tools to rebuild the Lucene index. Indexes are created based on the hibernate-search annotations on model objects such as @Indexed, @IndexedEmbedded, @Field, @ContainedIn, etc.
Prerequisites
- MySQL database must already exist (e.g. "tsdb").
- If no data exists in the database, this tool will clear the indexes.
- Otherwise, it will index the available data.
- MySQL database connection parameters must be defined in the properties file specified by "run.config.ts".
- The file system directory specified by the "hibernate.search.default.indexBase" in the properties file specified by run.config.ts must exist.
Details
This tool is used to rebuild Lucene indexes for objects indexed by the system.
Indexes are written into the directory specified by the hibernate.search.default.indexBase property in the properties file specified by "run.config.ts".
Following are some details about the implementation of this tool:
Mojo: LuceneReindexMojo.java (in admin/mojo/src/main/resources/java/org/ihtsdo/otf/ts/mojo)
Project: admin/lucene
Configuration Parameters
- run.config.ts - the standard configuration file specified as a -D parameter
indexed.objects - optional parameter that allows a comma-separated list of objects to reindex (e.g. MapRecordJpa). If omitted, all indexes are rebuilt.
server - true/false indicating whether to run the mojo through the server
Samples
Sample command line call of the admin tool to rebuild all indexes:
% cd ~/code/admin/lucene% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties |
Sample command line call of the admin tool to rebuild all indexes via a REST call to the server (here the run.config.ts is used to specify the base.url parameter, which is where the server is running):
% cd ~/code/admin/lucene% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties -Dserver=true |
Sample command line call of the admin tool to reindex only certain data types:
# Re-indexes only map records and tracking records% cd ~/code/admin/lucene% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties -Dindexed.objects=ConceptJpa |
Sample eclipse run configuration to rebuild all indexes:
Troubleshooting
Occasionally it is necessary to completely reindex all objects from scratch. When this is needed, the recommended approach is to remove the index files from the index and then run this mojo. For example:
# stop the server% service tomcat7 stop# remove the index% /bin/rm -rf /var/lib/tomcat7/indexes/*ConceptJpa# rebuild the index% cd ~/code/admin/lucene% mvn install -PReindex -Drun.config.ts=/home/ec2-tomcat/config/config.properties -Dindexed.objects=ConceptJpa # start the server% service tomcat7 start |
References/Links