1KinoSearch1::Analysis::UAsnearlyCzoenrt(r3ipbmu)ted PerlKiDnoocSuemaernctha1t:i:oAnnalysis::Analyzer(3pm)
2
3
4
6 KinoSearch1::Analysis::Analyzer - base class for analyzers
7
9 # abstract base class -- you probably want PolyAnalyzer, not this.
10
12 In KinoSearch1, an Analyzer is a filter which processes text,
13 transforming it from one form into another. For instance, an analyzer
14 might break up a long text into smaller pieces (Tokenizer), or it might
15 convert text to lowercase (LCNormalizer).
16
18 analyze (EXPERIMENTAL)
19 $token_batch = $analyzer->analyze($token_batch);
20
21 All Analyzer subclasses provide an "analyze" method. analyze() takes a
22 single TokenBatch as input, and it returns a TokenBatch, either the
23 same one (probably transformed in some way), or a new one.
24
26 Copyright 2005-2010 Marvin Humphrey
27
29 See KinoSearch1 version 1.01.
30
31
32
33perl v5.38.0 2023-07-2K0inoSearch1::Analysis::Analyzer(3pm)