# Uses of Package
opennlp.tools.tokenize

Packages that use opennlp.tools.tokenize
Package
Description
opennlp.tools.sentdetect
opennlp.tools.tokenize

- Classes in opennlp.tools.tokenize used by opennlp.tools.sentdetect
  Class
  Description
  Detokenizer
  A `Detokenizer` merges tokens back to their detokenized representation.
- Classes in opennlp.tools.tokenize used by opennlp.tools.tokenize
  Class
  Description
  Detokenizer
  A `Detokenizer` merges tokens back to their detokenized representation.
  Detokenizer.DetokenizationOperation
  This enum contains an operation for every token to merge the tokens together to their detokenized form.
  Tokenizer
  The interface for tokenizers, which segment a string into its tokens.
  TokenSample
  A `TokenSample` is text with token spans.
  WhitespaceTokenizer
  A basic `Tokenizer` implementation which performs tokenization using white spaces.