public final class LimitTokenCountAnalyzer extends AnalyzerWrapper
IndexWriter.LimitTokenCountFilterAnalyzer.ReuseStrategy, Analyzer.TokenStreamComponentsGLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY| Constructor and Description |
|---|
LimitTokenCountAnalyzer(Analyzer delegate,
int maxTokenCount)
Build an analyzer that limits the maximum number of tokens per field.
|
LimitTokenCountAnalyzer(Analyzer delegate,
int maxTokenCount,
boolean consumeAllTokens)
Build an analyzer that limits the maximum number of tokens per field.
|
| Modifier and Type | Method and Description |
|---|---|
protected Analyzer |
getWrappedAnalyzer(String fieldName)
Retrieves the wrapped Analyzer appropriate for analyzing the field with
the given name
|
String |
toString() |
protected Analyzer.TokenStreamComponents |
wrapComponents(String fieldName,
Analyzer.TokenStreamComponents components)
Wraps / alters the given TokenStreamComponents, taken from the wrapped
Analyzer, to form new components.
|
attributeFactory, createComponents, getOffsetGap, getPositionIncrementGap, initReader, initReaderForNormalization, normalize, wrapReader, wrapReaderForNormalization, wrapTokenStreamForNormalizationclose, getReuseStrategy, getVersion, normalize, setVersion, tokenStream, tokenStreampublic LimitTokenCountAnalyzer(Analyzer delegate, int maxTokenCount)
public LimitTokenCountAnalyzer(Analyzer delegate, int maxTokenCount, boolean consumeAllTokens)
delegate - the analyzer to wrapmaxTokenCount - max number of tokens to produceconsumeAllTokens - whether all tokens from the delegate should be consumed even if maxTokenCount is reached.protected Analyzer getWrappedAnalyzer(String fieldName)
AnalyzerWrappergetWrappedAnalyzer in class AnalyzerWrapperfieldName - Name of the field which is to be analyzedprotected Analyzer.TokenStreamComponents wrapComponents(String fieldName, Analyzer.TokenStreamComponents components)
AnalyzerWrapperwrapComponents in class AnalyzerWrapperfieldName - Name of the field which is to be analyzedcomponents - TokenStreamComponents taken from the wrapped Analyzer