
This package contains a set of shell scripts which simplify tagging 
with the TreeTagger. The scripts have been put into the cmd subdirectory.

In order to be able to call these scripts from other directories, you
should replace the relative paths in the scripts with absolute paths
and add the path of the cmd subdirectory to the command search path.
The installation script install.sh available on the TreeTagger webpage
updates the paths in the scripts automatically.

----------------------------------------------------

cmd/tree-tagger-english <file>*

This is a script for tagging English text. It does tokenization
and tagging. The names of the files which are to be tagged are
expected as arguments. If no files have been specified, input from
stdin is expected.

There are similar scripts for a couple of other languages:
cmd/tree-tagger-french 
cmd/tree-tagger-italian
...
All scripts expect UTF8 encoding of the input data.

cmd/tagger-chunker-german <file>

This is a script for tagging and chunking German text. It does
tokenization, tagging and annotation with nominal and verbal chunks.
The names of the files which are to be tagged are expected as
arguments. If no files have been specified, input from stdin is
expected.

Again there are similar scripts for other languages:
cmd/tagger-chunker-english
cmd/tagger-chunker-french

----------------------------------------------------

These files are needed by the shell scripts and are also contained in 
this tar-file:

cmd/filter-german-tags		error correction script
lib/english-abbreviations	list of English abbreviations
lib/german-abbreviations	list of German abbreviations
cmd/filter-chunker-output.perl	reformatting of the chunker output
cmd/mwl-lookup.perl		MWL recognition
cmd/filter-coordinate-output.perl needed by the French chunker

----------------------------------------------------

These files are needed by the shell scripts and *not* contained in this 
tar-file. They can be downloaded either as Linux programs or as MacOS
programs at the following URL:
http://www.cis.uni-muenchen.de/~schmid/tools/TreeTagger/
For installation, please follow the instructions on that webpage.

bin/tree-tagger		the tagger program proper
bin/separate-punctuation	tokenizer program
cmd/lookup.perl		external lexicon lookup
lib/english.par		English parameter file for the tagger
lib/german.par		German parameter file for the tagger
lib/french.par		French parameter file for the tagger
lib/italian.par		Italian parameter file for the tagger
lib/german-chunker.par	parameter file for the German chunker
lib/english-chunker.par	parameter file for the English chunker
lib/english-ctagger.par	parameter file for the POS tagger of the English chunker
lib/french-chunker.par	parameter file for the French chunker
lib/spanish-mwls	list of spanish MWLs
lib/german-lexicon.txt	German extension lexicon

----------------------------------------------------

Lexicon extension
-----------------

You can extend the lexicon of the German tagger by adding additional
entries to the files "german-lexicon.txt" in the subdirectory
"lib". Each line contains a word form followed by a tab character and
a sequence of tag/lemma-pairs separated by blanks. You can similarly
extend the lexicon of other tagger versions, say english, by

 - creating a file lib/english-lexicon.txt containing the additional
   lexicon entries
 
 - and replacing the line
      PARFILE=${LIB}/english.par
   in cmd/tree-tagger-english with
      PARFILE=${LIB}/english.par
      LEXFILE=${LIB}/english-lexicon.txt
   and replacing
       # tagging
       $TAGGER $OPTIONS $PARFILE  |
   with
       # external lexicon lookup
       perl $CMD/lookup.perl $LEXFILE |
       # tagging
       $TAGGER $OPTIONS $PARFILE  |
   analogous to how it is done in tree-tagger-german

