1KinoSearch1::Analysis::UAsnearlyCzoenrt(r3i)buted Perl DKoicnuomSeenatracthi1o:n:Analysis::Analyzer(3)
2
3
4
6 KinoSearch1::Analysis::Analyzer - base class for analyzers
7
9 # abstract base class -- you probably want PolyAnalyzer, not this.
10
12 In KinoSearch1, an Analyzer is a filter which processes text,
13 transforming it from one form into another. For instance, an analyzer
14 might break up a long text into smaller pieces (Tokenizer), or it might
15 convert text to lowercase (LCNormalizer).
16
18 analyze (EXPERIMENTAL)
19 $token_batch = $analyzer->analyze($token_batch);
20
21 All Analyzer subclasses provide an "analyze" method. "analyze()" takes
22 a single TokenBatch as input, and it returns a TokenBatch, either the
23 same one (probably transformed in some way), or a new one.
24
26 Copyright 2005-2010 Marvin Humphrey
27
29 See KinoSearch1 version 1.01.
30
31
32
33perl v5.32.0 2020-07-28KinoSearch1::Analysis::Analyzer(3)