1CONDOR_STATUS(1) HTCondor Manual CONDOR_STATUS(1)
2
3
4
6 condor_status - HTCondor Manual
7
8 Display status of the HTCondor pool
9
10
12 condor_status [-debug ] [help options ] [query options ] [display op‐
13 tions ] [custom options ] [name ... ]
14
16 condor_status is a versatile tool that may be used to monitor and query
17 the HTCondor pool. The condor_status tool can be used to query resource
18 information, submitter information, and daemon master information. The
19 specific query sent and the resulting information display is controlled
20 by the query options supplied. Queries and display formats can also be
21 customized.
22
23 The options that may be supplied to condor_status belong to five
24 groups:
25
26 • Help options provide information about the condor_status tool.
27
28 • Query options control the content and presentation of status informa‐
29 tion.
30
31 • Display options control the display of the queried information.
32
33 • Custom options allow the user to customize query and display informa‐
34 tion.
35
36 • Host options specify specific machines to be queried
37
38 At any time, only one help option, one query option and one display op‐
39 tion may be specified. Any number of custom options and host options
40 may be specified.
41
43 -debug Causes debugging information to be sent to stderr, based on
44 the value of the configuration variable TOOL_DEBUG.
45
46 -help (Help option) Display usage information.
47
48 -diagnose
49 (Help option) Print out ClassAd query without performing the
50 query.
51
52 -absent
53 (Query option) Query for and display only absent resources.
54
55 -ads filename
56 (Query option) Read the set of ClassAds in the file specified
57 by filename, instead of querying the condor_collector.
58
59 -annex name
60 (Query option) Query for and display only resources in the
61 named annex.
62
63 -any (Query option) Query all ClassAds and display their type,
64 target type, and name.
65
66 -avail (Query option) Query condor_startd ClassAds and identify re‐
67 sources which are available.
68
69 -claimed
70 (Query option) Query condor_startd ClassAds and print infor‐
71 mation about claimed resources.
72
73 -cod (Query option) Display only machine ClassAds that have COD
74 claims. Information displayed includes the claim ID, the
75 owner of the claim, and the state of the COD claim.
76
77 -collector
78 (Query option) Query condor_collector ClassAds and display
79 attributes.
80
81 -defrag
82 (Query option) Query condor_defrag ClassAds.
83
84 -direct hostname
85 (Query option) Go directly to the given host name to get the
86 ClassAds to display. By default, returns the condor_startd
87 ClassAd. If -schedd is also given, return the condor_schedd
88 ClassAd on that host.
89
90 -grid (Query option) Query grid resource ClassAds.
91
92 -java (Query option) Display only Java-capable resources.
93
94 -license
95 (Query option) Display license attributes.
96
97 -master
98 (Query option) Query condor_master ClassAds and display dae‐
99 mon master attributes.
100
101 -negotiator
102 (Query option) Query condor_negotiator ClassAds and display
103 attributes.
104
105 -pool centralmanagerhostname[:portnumber]
106 (Query option) Query the specified central manager using an
107 optional port number. condor_status queries the machine spec‐
108 ified by the configuration variable COLLECTOR_HOST by de‐
109 fault.
110
111 -run (Query option) Display information about machines currently
112 running jobs.
113
114 -schedd
115 (Query option) Query condor_schedd ClassAds and display at‐
116 tributes.
117
118 -server
119 (Query option) Query condor_startd ClassAds and display re‐
120 source attributes.
121
122 -startd
123 (Query option) Query condor_startd ClassAds.
124
125 -state (Query option) Query condor_startd ClassAds and display re‐
126 source state information.
127
128 -statistics WhichStatistics
129 (Query option) Can only be used if the -direct option has
130 been specified. Identifies which Statistics attributes to in‐
131 clude in the ClassAd. WhichStatistics is specified using the
132 same syntax as defined for STATISTICS_TO_PUBLISH. A defini‐
133 tion is in the HTCondor Administrator's manual section on
134 configuration (admin-manual/configuration-macros:htcon‐
135 dor-wide configuration file entries).
136
137 -storage
138 (Query option) Display attributes of machines with network
139 storage resources.
140
141 -submitters
142 (Query option) Query ClassAds sent by submitters and display
143 important submitter attributes.
144
145 -subsystem type
146 (Query option) If type is one of collector, negotiator, mas‐
147 ter, schedd, or startd, then behavior is the same as the
148 query option without the -subsystem option. For example,
149 -subsystem collector is the same as -collector. A value of
150 type of CkptServer, Machine, DaemonMaster, or Scheduler tar‐
151 gets that type of ClassAd.
152
153 -vm (Query option) Query condor_startd ClassAds, and display only
154 VM-enabled machines. Information displayed includes the ma‐
155 chine name, the virtual machine software version, the state
156 of machine, the virtual machine memory, and the type of net‐
157 working.
158
159 -offline
160 (Query option) Query condor_startd ClassAds, and display, for
161 each machine with at least one offline universe, which uni‐
162 verses are offline for it.
163
164 -attributes Attr1[,Attr2 ...]
165 (Display option) Explicitly list the attributes in a comma
166 separated list which should be displayed when using the -xml,
167 -json or -long options. Limiting the number of attributes in‐
168 creases the efficiency of the query.
169
170 -expert
171 (Display option) Display shortened error messages.
172
173 -long (Display option) Display entire ClassAds. Implies that totals
174 will not be displayed.
175
176 -limit num
177 (Query option) At most num results should be displayed.
178
179 -sort expr
180 (Display option) Change the display order to be based on as‐
181 cending values of an evaluated expression given by expr.
182 Evaluated expressions of a string type are in a case insensi‐
183 tive alphabetical order. If multiple -sort arguments appear
184 on the command line, the primary sort will be on the leftmost
185 one within the command line, and it is numbered 0. A sec‐
186 ondary sort will be based on the second expression, and it is
187 numbered 1. For informational or debugging purposes, the
188 ClassAd output to be displayed will appear as if the ClassAd
189 had two additional attributes. CondorStatusSortKeyExpr<N> is
190 the expression, where <N> is replaced by the number of the
191 sort. CondorStatusSortKey<N> gives the result of evaluating
192 the sort expression that is numbered <N>.
193
194 -total (Display option) Display totals only.
195
196 -xml (Display option) Display entire ClassAds, in XML format. The
197 XML format is fully defined in the reference manual, obtained
198 from the ClassAds web page, with a link at
199 http://htcondor.org/classad/classad.html.
200
201 -json (Display option) Display entire ClassAds in JSON format.
202
203 -constraint const
204 (Custom option) Add constraint expression.
205
206 -compact
207 (Custom option) Show compact form, with a single line per ma‐
208 chine using information from the partitionable slot. Some
209 information will be incorrect if the machine has static
210 slots.
211
212 -format fmt attr
213 (Custom option) Display attribute or expression attr in for‐
214 mat fmt. To display the attribute or expression the format
215 must contain a single printf(3)-style conversion specifier.
216 Attributes must be from the resource ClassAd. Expressions are
217 ClassAd expressions and may refer to attributes in the re‐
218 source ClassAd. If the attribute is not present in a given
219 ClassAd and cannot be parsed as an expression, then the for‐
220 mat option will be silently skipped. %r prints the unevalu‐
221 ated, or raw values. The conversion specifier must match the
222 type of the attribute or expression. %s is suitable for
223 strings such as Name, %d for integers such as LastHeardFrom,
224 and %f for floating point numbers such as LoadAvg. %v identi‐
225 fies the type of the attribute, and then prints the value in
226 an appropriate format. %V identifies the type of the attri‐
227 bute, and then prints the value in an appropriate format as
228 it would appear in the -long format. As an example, strings
229 used with %V will have quote marks. An incorrect format will
230 result in undefined behavior. Do not use more than one con‐
231 version specifier in a given format. More than one conversion
232 specifier will result in undefined behavior. To output multi‐
233 ple attributes repeat the -format option once for each de‐
234 sired attribute. Like printf(3)-style formats, one may in‐
235 clude other text that will be reproduced directly. A format
236 without any conversion specifiers may be specified, but an
237 attribute is still required. Include a backslash followed by
238 an 'n' to specify a line break.
239
240 -autoformat[:lhVr,tng] attr1 [attr2 ...] or -af[:lhVr,tng] attr1
241 [attr2 ...]
242 (Output option) Display attribute(s) or expression(s) format‐
243 ted in a default way according to attribute types. This op‐
244 tion takes an arbitrary number of attribute names as argu‐
245 ments, and prints out their values, with a space between each
246 value and a newline character after the last value. It is
247 like the -format option without format strings. This output
248 option does not work in conjunction with the -run option.
249
250 It is assumed that no attribute names begin with a dash char‐
251 acter, so that the next word that begins with dash is the
252 start of the next option. The autoformat option may be fol‐
253 lowed by a colon character and formatting qualifiers to devi‐
254 ate the output formatting from the default:
255
256 l label each field,
257
258 h print column headings before the first line of output,
259
260 V use %V rather than %v for formatting (string values are
261 quoted),
262
263 r print "raw", or unevaluated values,
264
265 , add a comma character after each field,
266
267 t add a tab character before each field instead of the de‐
268 fault space character,
269
270 n add a newline character after each field,
271
272 g add a newline character between ClassAds, and suppress spa‐
273 ces before each field.
274
275 Use -af:h to get tabular values with headings.
276
277 Use -af:lrng to get -long equivalent format.
278
279 The newline and comma characters may not be used together.
280 The l and h characters may not be used together.
281
282 -print-format file
283 Read output formatting information from the given custom
284 print format file. see Print Formats for more information
285 about custom print format files.
286
287 -target filename
288 (Custom option) Where evaluation requires a target ClassAd to
289 evaluate against, file filename contains the target ClassAd.
290
291 -merge filename
292 (Custom option) Ads will be read from filename, which may be
293 - to indicate standard in, and compared to the ads selected
294 by the query specified by the remainder of the command line.
295 Ads will be considered the same if their sort keys match;
296 sort keys may be specified with [-sort <key>]. This option
297 will cause up to three tables to print, in the following or‐
298 der, depending on where a given ad appeared: first, the ads
299 which appeared in the query but not in filename; second, the
300 ads which appeared in both the query and in filename; third,
301 the ads which appeared in filename but not in the query.
302
303 By default, banners will label each table. If -xml is also
304 given, the same banners will separate three valid XML docu‐
305 ments, one for each table. If -json is also given, a single
306 JSON object will be produced, with the usual JSON output for
307 each table labeled as an element in the object.
308
309 The -annex option changes this default so that the banners
310 are not printed and the tables are formatted differently. In
311 this case, the ads in filename are expected to have different
312 contents from the ads in the query, so many others will be‐
313 have strangely.
314
316 • The default output from condor_status is formatted to be human read‐
317 able, not script readable. In an effort to make the output fit within
318 80 characters, values in some fields might be truncated. Further‐
319 more, the HTCondor Project can (and does) change the formatting of
320 this default output as we see fit. Therefore, any script that is at‐
321 tempting to parse data from condor_status is strongly encouraged to
322 use the -format option (described above).
323
324 • The information obtained from condor_startd and condor_schedd daemons
325 may sometimes appear to be inconsistent. This is normal since con‐
326 dor_startd and condor_schedd daemons update the HTCondor manager at
327 different rates, and since there is a delay as information propagates
328 through the network and the system.
329
330 • Note that the ActivityTime in the Idle state is not the amount of
331 time that the machine has been idle. See the section on condor_startd
332 states in the Administrator's Manual for more information (Starting
333 Up, Shutting Down, Reconfiguring, and Restarting HTCondor).
334
335 • When using condor_status on a pool with SMP machines, you can either
336 provide the host name, in which case you will get back information
337 about all slots that are represented on that host, or you can list
338 specific slots by name. See the examples below for details.
339
340 • If you specify host names, without domains, HTCondor will automati‐
341 cally try to resolve those host names into fully qualified host names
342 for you. This also works when specifying specific nodes of an SMP ma‐
343 chine. In this case, everything after the "@" sign is treated as a
344 host name and that is what is resolved.
345
346 • You can use the -direct option in conjunction with almost any other
347 set of options. However, at this time, not all daemons will respond
348 to direct queries for its ad(s). The condor_startd will respond to
349 requests for Startd ads. The condor_schedd will respond to requests
350 for Schedd and Submitter ads. So the only options currently not sup‐
351 ported with -direct are -master and -collector. Most other options
352 use startd ads for their information, so they work seamlessly with
353 -direct. The only other restriction on -direct is that you may only
354 use 1 -direct option at a time. If you want to query information di‐
355 rectly from multiple hosts, you must run condor_status multiple
356 times.
357
358 • Unless you use the local host name with -direct, condor_status will
359 still have to contact a collector to find the address where the spec‐
360 ified daemon is listening. So, using a -pool option in conjunction
361 with -direct just tells condor_status which collector to query to
362 find the address of the daemon you want. The information actually
363 displayed will still be retrieved directly from the daemon you speci‐
364 fied as the argument to -direct. Do not use -direct to query the
365 Collector ad, just use -pool and -collector.
366
368 Example 1 To view information from all nodes of an SMP machine, use
369 only the host name. For example, if you had a 4-CPU machine, named vul‐
370 ture.cs.wisc.edu, you might see
371
372 $ condor_status vulture
373
374 Name OpSys Arch State Activity LoadAv Mem ActvtyTime
375
376 slot1@vulture.cs.w LINUX INTEL Claimed Busy 1.050 512 0+01:47:42
377 slot2@vulture.cs.w LINUX INTEL Claimed Busy 1.000 512 0+01:48:19
378 slot3@vulture.cs.w LINUX INTEL Unclaimed Idle 0.070 512 1+11:05:32
379 slot4@vulture.cs.w LINUX INTEL Unclaimed Idle 0.000 512 1+11:05:34
380
381 Total Owner Claimed Unclaimed Matched Preempting Backfill
382
383 INTEL/LINUX 4 0 2 2 0 0 0
384
385 Total 4 0 2 2 0 0 0
386
387 Example 2 To view information from a specific nodes of an SMP machine,
388 specify the node directly. You do this by providing the name of the
389 slot. This has the form slot#@hostname. For example:
390
391 $ condor_status slot3@vulture
392
393 Name OpSys Arch State Activity LoadAv Mem ActvtyTime
394
395 slot3@vulture.cs.w LINUX INTEL Unclaimed Idle 0.070 512 1+11:10:32
396
397 Total Owner Claimed Unclaimed Matched Preempting Backfill
398
399 INTEL/LINUX 1 0 0 1 0 0 0
400
401 Total 1 0 0 1 0 0 0
402
403 Example 3 The -compact option gives a one line summary of each machine
404 using information from the partitionable slot. If the normal output is
405 this
406
407 $ condor_status vulture
408
409 Name OpSys Arch State Activity LoadAv Mem ActvtyTime
410
411 slot1@vulture.cs.w LINUX X86_64 Unclaimed Idle 0.000 679 1+03:18:58
412 slot1_1@vulture.cs LINUX X86_64 Claimed Busy 1.160 1152 0+03:21:02
413 slot1_2@vulture.cs LINUX X86_64 Claimed Busy 1.150 2560 0+10:20:50
414 slot1_3@vulture.cs LINUX X86_64 Claimed Busy 1.160 2816 0+01:32:08
415 slot1_4@vulture.cs LINUX X86_64 Claimed Busy 0.000 5081 0+00:00:00
416
417 Machines Owner Claimed Unclaimed Matched Preempting Drain
418
419 X86_64/LINUX 5 0 4 1 0 0 0
420
421 Total 5 0 4 1 0 0 0
422
423 For the same machine in the same state the -compact option will show
424 this
425
426 $ condor_status -compact vulture
427
428 Machine Platform Slots Cpus Gpus TotalGb FreCpu FreeGb CpuLoad ST Jobs/Min MaxSlotGb
429
430 vulture.cs.wisc.ed x64/CentOS7 4 8 2 12 0 .66 .98 Cb .25 4.96
431
432 Machines Owner Claimed Unclaimed Matched Preempting Drain
433
434 X86_64/CentOS7 4 0 4 1 0 0 0
435
436 Total 4 0 4 1 0 0 0
437
438 The Slots column shows that 4 slots have been carved out of the parti‐
439 tionable slot, leaving 0 cpus and .66 Gigabytes of memory free. Static
440 slots will not be counted in the Slots column.
441
442 The ST column shows the consensus state of the dynamic slots using a
443 two character code. The first character is the State, the second is the
444 activity. If there is not a consensus for either the state or activity,
445 then # will be shown. The example shows Cb for Claimed/Busy since all
446 of the dynamic slots are in that state. If one of the dynamic slots
447 were Idle, then C# would be shown.
448
449 The Jobs/Min shows the recent job start rate for the machine. A large
450 number here is normal for a machine that just came online, but if this
451 number stays above 1 for more than a minute, that can be an indication
452 of a machine is acting as a black hole for jobs, starting them quickly
453 and then failing them just as quickly.
454
455 The MaxSlotGb column shows the memory allocated to the largest slot in
456 Gigabytes, If the memory allocated for the largest slot cannot be de‐
457 termined, * will be displayed. Static slots are not counted in the
458 MaxSlotGb column.
459
460 Constraint option examples
461
462 The Unix command to use the constraint option to see all machines with
463 the OpSys of "LINUX":
464
465 $ condor_status -constraint OpSys==\"LINUX\"
466
467 Note that quotation marks must be escaped with the backslash characters
468 for most shells.
469
470 The Windows command to do the same thing:
471
472 > condor_status -constraint " OpSys==""LINUX"" "
473
474 Note that quotation marks are used to delimit the single argument which
475 is the expression, and the quotation marks that identify the string
476 must be escaped by using a set of two double quote marks without any
477 intervening spaces.
478
479 To see all machines that are currently in the Idle state, the Unix com‐
480 mand is
481
482 $ condor_status -constraint State==\"Idle\"
483
484 To see all machines that are bench marked to have a MIPS rating of more
485 than 750, the Unix command is
486
487 $ condor_status -constraint 'Mips>750'
488
489 -cod option example
490
491 The -cod option displays the status of COD claims within a given HTCon‐
492 dor pool.
493
494 Name ID ClaimState TimeInState RemoteUser JobId Keyword
495 astro.cs.wi COD1 Idle 0+00:00:04 wright
496 chopin.cs.w COD1 Running 0+00:02:05 wright 3.0 fractgen
497 chopin.cs.w COD2 Suspended 0+00:10:21 wright 4.0 fractgen
498
499 Total Idle Running Suspended Vacating Killing
500 INTEL/LINUX 3 1 1 1 0 0
501 Total 3 1 1 1 0 0
502
503 -format option example To display the name and memory attributes of
504 each job ClassAd in a format that is easily parsable by other tools:
505
506 $ condor_status -format "%s " Name -format "%d\n" Memory
507
508 To do the same with the autoformat option, run
509
510 $ condor_status -autoformat Name Memory
511
513 condor_status will exit with a status value of 0 (zero) upon success,
514 and it will exit with the value 1 (one) upon failure.
515
517 HTCondor Team
518
520 1990-2023, Center for High Throughput Computing, Computer Sciences De‐
521 partment, University of Wisconsin-Madison, Madison, WI, US. Licensed
522 under the Apache License, Version 2.0.
523
524
525
526
527 Oct 02, 2023 CONDOR_STATUS(1)