Contents
- Introduction
- Description of resources
    - lvg.properties
    - LVG database
- Running the LVG annotator
	- LvgAnnotator.xml
	- AggregateAE.xml

############
Introduction
############

This annotator wraps the National Library of Medicine (NLM) SPECIALIST lexical tools.

See the documentation for the SPECIALIST lexical tools at
http://lexsrv2.nlm.nih.gov/LexSysGroup/Projects/lvg/current/index.html
  
And also see the documentation for Lvg and Norm at 
http://lexsrv2.nlm.nih.gov/LexSysGroup/Projects/lvg/current/docs/userDoc/index.html
  
This annotator generates a canonical form for each word and also generates a list of lemma 
entries with Penn Treebank tags.  These tags could be useful for a part of speech (POS) tagger.

However, for the OpenNLP POS tagger, we use a tag dictionary rather than lemma information.
See the documentation for the POS tagger annotator. 


########################
Description of resources
########################

%%%%%%%%%%%%%%%%
lvg.properties
%%%%%%%%%%%%%%%%
The LVG config file  resources/lvg/data/config/lvg.properties  defines the location
and attributes of the LVG database and the jdbc driver used.

%%%%%%%%%%%%%%%%
LVG database
%%%%%%%%%%%%%%%%

The database engine used is hsqldb. 

The LVG database available from the NLM is hundreds of megabytes.  To keep this 
project relatively small, the database tables included with this project have a 
relatively small number of rows.
 
To use the full lvg2008 database, download either lvg2008lite.tgz or lvg2008.tgz from 
http://lexsrv3.nlm.nih.gov/SPECIALIST/Projects/lvg/2008/index.html
and extract  data/HSqlDb  from that download to a temporary location.
Then replace the  resources/lvg/data/HSqlDb  directory in this project with 
the  data/HSqlDb  directory from that download.

#########################
Running the LVG annotator
#########################

%%%%%%%%%%%%%%%%
LvgAnnotator.xml
%%%%%%%%%%%%%%%%

The parameters are:
  UseSegments - controls whether only certain sections will be annotated by this annotator
  SegmentsToSkip - list of sections not to be processed by this annotator 
  UseCmdCache - controls whether to look up information in a cache before using norm
  CmdCacheFileLocation - location of norm cache file
  CmdCacheFrequencyCutoff - 
  ExclusionSet - words for which canonicalForm is never set and Lemma entries are never posted
  XeroxTreebankMap - mapping of part of speech tags, used to POS tags from lexical tools to Penn Treebank tags
  PostLemmas - controls whether any lemma entries are posted to the CAS  
  UseLemmaCache - controls whether to look up lemma information in a cache before using lvg
  LemmaCacheFileLocation - the location of the cache file 
  LemmaCacheFileFrequencyCutoff - 

Note: as distributed, PostLemmas is set to false.  This is done to reduce the size of the CAS.
Set PostLemmas to true to have edu.mayo.bmi.uima.core.type.Lemma annotations added to the CAS.