1NGRAMPERPLEXITY(1)               User Commands              NGRAMPERPLEXITY(1)
2
3
4

NAME

6       ngramperplexity - manual page for ngramperplexity 1.3.4
7

DESCRIPTION

9       Apply n-gram model to input fst archive.
10
11              Usage: ngramperplexity [--options] ngram.fst [in.far [out.txt]]
12
13       PROGRAM FLAGS:
14
15       --OOV_class_size: type = double, default = 10000
16
17              Number of members of OOV class --OOV_probability: type = double,
18              default = 0 Unigram probability for OOVs  --OOV_symbol:  type  =
19              string,  default  =  ""  Existing  symbol  for  OOV class --con‐
20              text_pattern: type = string, default =  ""  Restrict  perplexity
21              computation to contexts defined by pattern (default: no restric‐
22              tion) --use_phimatcher: type = bool, default  =  false  Use  phi
23              matcher and composition
24
25       LIBRARY FLAGS:
26
27       Flags from: flags.cc
28
29       --help: type = bool, default = false
30
31              show usage information --helpshort: type = bool, default = false
32              show brief usage information --tmpdir: type = string, default  =
33              "/tmp"  temporary  directory --v: type = int32, default = 0 ver‐
34              bosity level
35
36       Flags from: fst.cc
37
38       --fst_align: type = bool, default = false
39
40              Write FST data aligned where appropriate --fst_default_cache_gc:
41              type  =  bool, default = true Enable garbage collection of cache
42              --fst_default_cache_gc_limit: type = int64,  default  =  1048576
43              Cache    byte    size    that    triggers   garbage   collection
44              --fst_read_mode: type = string, default =  "read"  Default  file
45              reading  mode for mappable files --fst_verify_properties: type =
46              bool, default = false Verify FST properties queried by TestProp‐
47              erties  --save_relabel_ipairs:  type = string, default = "" Save
48              input  relabel  pairs  to  file  --save_relabel_opairs:  type  =
49              string, default = "" Save output relabel pairs to file
50
51       Flags from: ngram-output.cc
52
53       --end_symbol: type = string, default = "</s>"
54
55              Class  label  for  sentence  end  --start_symbol: type = string,
56              default = "<s>" Class label for sentence start
57
58       Flags from: symbol-table.cc
59
60       --fst_compat_symbols: type = bool, default = true
61
62              Require symbol tables to match when appropriate --fst_field_sep‐
63              arator: type = string, default = "      " Set of characters used
64              as a separator between printed fields
65
66       Flags from: util.cc
67
68       --fst_error_fatal: type = bool, default = true
69
70              FST errors are fatal; o.w. return objects flagged as bad:  e.g.,
71              FSTs:   kError   property  set,  FST  weights:  not  a  Member()
72              --ngram_error_fatal: type = bool, default =  true  NGram  errors
73              are  fatal  if  true;  otherwise returns objects flagged as bad:
74              e.g., NGramModel::Error() is true
75
76       Flags from: weight.cc
77
78       --fst_weight_parentheses: type = string, default = ""
79
80              Characters enclosing the first weight  of  a  printed  composite
81              weight  (e.g., pair weight, tuple weight and derived classes) to
82              ensure proper I/O of nested composite weights; must have size  0
83              (none) or 2 (open and close parenthesis) --fst_weight_separator:
84              type = string, default = "," Character separator between printed
85              composite weights; must be a single character
86
87
88
89ngramperplexity 1.3.4            January 2018               NGRAMPERPLEXITY(1)