public class WhitespaceTokenizer extends CharTokenizer
AttributeSource.AttributeFactory, AttributeSource.State
Constructor and Description |
---|
WhitespaceTokenizer(AttributeSource.AttributeFactory factory,
java.io.Reader in)
Construct a new WhitespaceTokenizer using a given
AttributeSource.AttributeFactory . |
WhitespaceTokenizer(AttributeSource source,
java.io.Reader in)
Construct a new WhitespaceTokenizer using a given
AttributeSource . |
WhitespaceTokenizer(java.io.Reader in)
Construct a new WhitespaceTokenizer.
|
Modifier and Type | Method and Description |
---|---|
protected boolean |
isTokenChar(char c)
Collects only characters which do not satisfy
Character.isWhitespace(char) . |
end, incrementToken, next, next, normalize, reset
close, correctOffset
getOnlyUseNewAPI, reset, setOnlyUseNewAPI
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
public WhitespaceTokenizer(java.io.Reader in)
public WhitespaceTokenizer(AttributeSource source, java.io.Reader in)
AttributeSource
.public WhitespaceTokenizer(AttributeSource.AttributeFactory factory, java.io.Reader in)
AttributeSource.AttributeFactory
.protected boolean isTokenChar(char c)
Character.isWhitespace(char)
.isTokenChar
in class CharTokenizer
Copyright © 2000-2016 Apache Software Foundation. All Rights Reserved.