1NGRAMPERPLEXITY(1) User Commands NGRAMPERPLEXITY(1)
2
3
4
6 ngramperplexity - manual page for ngramperplexity 1.3.4
7
9 Apply n-gram model to input fst archive.
10
11 Usage: ngramperplexity [--options] ngram.fst [in.far [out.txt]]
12
13 PROGRAM FLAGS:
14
15 --OOV_class_size: type = double, default = 10000
16
17 Number of members of OOV class --OOV_probability: type = double,
18 default = 0 Unigram probability for OOVs --OOV_symbol: type =
19 string, default = "" Existing symbol for OOV class --con‐
20 text_pattern: type = string, default = "" Restrict perplexity
21 computation to contexts defined by pattern (default: no restric‐
22 tion) --use_phimatcher: type = bool, default = false Use phi
23 matcher and composition
24
25 LIBRARY FLAGS:
26
27 Flags from: flags.cc
28
29 --help: type = bool, default = false
30
31 show usage information --helpshort: type = bool, default = false
32 show brief usage information --tmpdir: type = string, default =
33 "/tmp" temporary directory --v: type = int32, default = 0 ver‐
34 bosity level
35
36 Flags from: fst.cc
37
38 --fst_align: type = bool, default = false
39
40 Write FST data aligned where appropriate --fst_default_cache_gc:
41 type = bool, default = true Enable garbage collection of cache
42 --fst_default_cache_gc_limit: type = int64, default = 1048576
43 Cache byte size that triggers garbage collection
44 --fst_read_mode: type = string, default = "read" Default file
45 reading mode for mappable files --fst_verify_properties: type =
46 bool, default = false Verify FST properties queried by TestProp‐
47 erties --save_relabel_ipairs: type = string, default = "" Save
48 input relabel pairs to file --save_relabel_opairs: type =
49 string, default = "" Save output relabel pairs to file
50
51 Flags from: ngram-output.cc
52
53 --end_symbol: type = string, default = "</s>"
54
55 Class label for sentence end --start_symbol: type = string, de‐
56 fault = "<s>" Class label for sentence start
57
58 Flags from: symbol-table.cc
59
60 --fst_compat_symbols: type = bool, default = true
61
62 Require symbol tables to match when appropriate --fst_field_sep‐
63 arator: type = string, default = " " Set of characters used
64 as a separator between printed fields
65
66 Flags from: util.cc
67
68 --fst_error_fatal: type = bool, default = true
69
70 FST errors are fatal; o.w. return objects flagged as bad: e.g.,
71 FSTs: kError property set, FST weights: not a Member()
72 --ngram_error_fatal: type = bool, default = true NGram errors
73 are fatal if true; otherwise returns objects flagged as bad:
74 e.g., NGramModel::Error() is true
75
76 Flags from: weight.cc
77
78 --fst_weight_parentheses: type = string, default = ""
79
80 Characters enclosing the first weight of a printed composite
81 weight (e.g., pair weight, tuple weight and derived classes) to
82 ensure proper I/O of nested composite weights; must have size 0
83 (none) or 2 (open and close parenthesis) --fst_weight_separator:
84 type = string, default = "," Character separator between printed
85 composite weights; must be a single character
86
87
88
89ngramperplexity 1.3.4 January 2018 NGRAMPERPLEXITY(1)