# Package opennlp.uima.tokenize

package opennlp.uima.tokenize
Package related to finding tokens or word segments.

- Class
  Description
  AbstractTokenizer
  SimpleTokenizer
  An OpenNLP-based Simple Tokenizer annotator.
  Tokenizer
  An OpenNLP-based Tokenizer annotator.
  TokenizerModelResource
  A resource encapsulating an OpenNLP `TokenizerModel` which can be shared between analysis engines and loaded via the UIMA resource model.
  TokenizerModelResourceImpl
  A default implementation of `TokenizerModelResource`.
  WhitespaceTokenizer
  An OpenNLP-based Whitespace Tokenizer annotator.