1PQ2-ANA-DIST(1) General Commands Manual PQ2-ANA-DIST(1)
2
6 The PQ2 tools are deprecated will be removed in ROOT v6.16/00.
7 Please contact the ROOT team at http://root.cern.ch in the unlikely
9 event this change is disruptive for your workflow.
10
12 pq2-ana-dist - Analyse the file distribution of a dataset (or a set of
13 datasets) from a dataset meta-repository based on ROOT files
14
16 pq2-ana-dist [options] datasets
17
19 This manual page documents briefly the pq2-ana-dist program.
20 pq2-ana-dist is a script invoking the pq2 ROOT application to analyse
22 the file distribution of a dataset (or a set of datasets) over the file
23 servers, either in terms of files or of file sizes. The output is a
24 text file with the the file movements needed to make the file distribu‐
25 tion even in the chosen metrics to be used, for example, as in input to
26 pq2-redistribute(1). Optionally the internal objects can be saved so
27 that they can be used as starting point for a subsequent run. An his‐
28 togram and a plot can also be saved to visualize the file distribution.
29 The repository with the dataset information can be accessed via the
30 local file system or a remote file server daemon or a PROOF facility.
31 More details about the underlying 'pq2' application can be found in the
33 man page pq2(1).
34
36 datasets
37 Comma-separated list of datasets to be analysed; the '*' wild
38 card in the items (in such a case the full string - as shown by
39 pq2-ls - should be given in quotes, e.g.
40 '/default/ganis/h1-set5*'.
41
43 -h, --help
44 Display help information.
45 -k, --keep
47 Keep the temporary files created during the analysis under
48 $TMPDIR
49 -v Verbose mode
51 --dataset=<datasets>
53 Alternative way to define the datasets to be analysed.
54 -s <servers>, --servers=<servers>
56 Comma-separated list of servers to be used (-s) in the analysis;
57 a '+' in front of the list adds the specified servers to the
58 existing ones: this can be useful when determining file move‐
59 ments to empty or new servers
60 -e <excsrvs>, --exclude=<excsrvs>
62 Comma-separated list of servers to be excluded from the target
63 servers; this can be used, for example, to determine the files
64 movements to drain a server.
65 -i <ignsrvs>, --ignore=<ignsrvs>
67 Comma-separated list of servers to be ignored in the analysis;
68 this can be used, for example, to skip the redirector.
69 -m <metrics>, --metrics=<metrics>
71 Metrics to be used to calculate the degree of evenness:
72 F use the number of files (default)
73 S use the file size
74 -f <filemv>, --filemv=<filemv>
76 Defines the file where to save the result of the analysis; by
77 the default the result is send to the screen. The output con‐
78 tains one line per each file that needs to be moved with the
79 format 'file source destination' where 'file' is the file name,
80 'source' is the source server URL and 'destination' is the des‐
81 tination server URL. The file can be used as input, for exam‐
82 ple, to pq2-redistribute(1).
83 --plot[=<fileplot.fmt>]
85 Defines the file with the output plot with the original distri‐
86 bution with the server names and the +-10% limits; the extension
87 (if known) defines the format; the default format is 'png' and
88 the default name 'plot.png'. The plot can also be obtained
89 directly from a binary output file (saved with '--fout=<out‐
90 file>.root') but just specifying '--fin=<outfile>.root --plot'.
91 The available formats are those known by ROOT: png (default),
92 eps, ps, pdf, svg, gif, xpm, jpg, tiff.
93 --fout[=<outfile>]
95 Defines the file where to save the output of the analysis in
96 binary form (ROOT file); this output can be used as starting
97 point for a next run, allowing to run over many datasets in sep‐
98 arate steps.
99 --fin[=<infile>]
101 Defines the ROOT file from where to fetch the output of a previ‐
102 ous run (saved with --fout=infile).
103 -u <serverurl>, --url=<serverurl>
105 URL of the PROOF master or data server providing the informa‐
106 tion; for data servers, it must include the directory. Can also
107 be specified via the environment variables PQ2PROOFURL or
108 PQ2DSSRVURL (see ENVIRONMENT VARIABLES)."
109 -t <dir>, --tmpdir=<dir>
111 Directory for temporary files; default is /tmp/<username>.
112
114 The out file consists of one line per file to be moved with the follow‐
115 ing format:
116 file-name source-server-URL destination-server-URL
118
120 See setup-pq2(1).
121
123 pq2(1), setup-pq2(1), pq2-ls(1), pq2-ls-files(1), pq2-ls-files-
124 server(1), pq2-info-server(1), pq2-redistribute(1), pq2-verify(1),
125 pq2-rm(1), pq2-cache(1)
126 For more information on the ROOT system, please refer to
128 http://root.cern.ch
129
131 Gerardo Ganis for the ROOT team.
132
134 This library is free software; you can redistribute it and/or modify it
135 under the terms of the GNU Lesser General Public License as published
136 by the Free Software Foundation; either version 2.1 of the License, or
137 (at your option) any later version.
138 This library is distributed in the hope that it will be useful, but
140 WITHOUT ANY WARRANTY; without even the implied warranty of MER‐
141 CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Lesser
142 General Public License for more details.
143 You should have received a copy of the GNU Lesser General Public
145 License along with this library; if not, write to the Free Software
146 Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301
147 USA
148
150 This manual page was originally written by Gerardo Ganis <ger‐
151 ardo.ganis@cern.ch>, for ROOT version 5.
152ROOT Version 5 PQ2-ANA-DIST(1)