1just-man-pages/condor_qsub(1)General Commands Manuajlust-man-pages/condor_qsub(1)
2
6 condor_qsub Queue jobs that use PBS/SGE-style submission
7
9 condor_qsub [ -- version ]
10 condor_qsub [ Specific options ] [ Directory options ] [ Environmental
12 options ] [ File options ] [ Notification options ] [ Resource options
13 ] [ Status options ] [ Submission options ] commandfile
14
16 condor_qsub submits an HTCondor job. This job is specified in a
17 PBS/Torque style or an SGE style. condor_qsub permits the submission
18 of dependent jobs without the need to specify the full dependency graph
19 at submission time. Doing things this way is neither as efficient as
20 HTCondor's DAGMan, nor as functional as SGE's qsub or qalter . con‐
21 dor_qsub serves as a minimal translator to be able to use software
22 originally written to interact with PBS, Torque, and SGE in an HTCondor
23 pool.
24 condor_qsub attempts to behave like qsub . Less than half of the qsub
26 functionality is implemented. Option descriptions describe the differ‐
27 ences between the behavior of qsub and condor_qsub . qsub options not
28 listed here are not supported. Some concepts present in PBS and SGE do
29 not apply to HTCondor, and so these options are not implemented.
30 For a full listing of qsub options, please see
32 POSIX
34 : http://pubs.opengroup.org/onlinepubs/9699919799/utili‐
36 ties/qsub.html
37 SGE
41 : http://gridscheduler.sourceforge.net/htmlman/htmlman1/qsub.html
43 PBS/Torque
47 : http://docs.adaptivecomputing.com/torque/4-1-3/Content/topics/com‐
49 mands/qsub.htm
50 condor_qsub accepts either command line options or the single file,
54 commandfile , that contains all of the commands.
55 condor_qsub does the opposite of job submission within the grid uni‐
57 verse batch grid type, which takes HTCondor jobs submitted with HTCon‐
58 dor syntax and submits them to PBS, SGE, or LSF.
59
61 -a date_time
62 (Submission option) Specify a deferred execution date and time. The
64 PBS/Torque syntax of date_time is a string in the form
65 [[[[CC]YY]MM]DD]hhmm[.SS] . The portions of this string which are
66 optional are CC , YY , MM , DD , and SS . For SGE, MM and DD are not
67 optional. For PBS, MM and DD are optional. condor_qsub follows the
68 PBS style.
69 -A account_string
73 (Status option) Uses group accounting where the string
75 account_string is the accounting group associated with this job.
76 Unlike SGE, there is no default group of "sge" .
77 -b y|n
81 (Submission option) Using the SGE definition of its -b option, a
83 value of y causes condor_qsub to not parse the file for additional
84 condor_qsub commands. The default value is n . If the command line
85 argument -f filename is also specified, it negates a value of y .
86 -c checkpoint_option
90 (Submission option) For standard universe jobs only, controls the
92 how HTCondor produces checkpoints. checkpoint_options may be one of
93 n or N
95 Do not produce checkpoints.
97 s or S
101 Do not produce periodic checkpoints. A job will only produce a
103 checkpoint when the job is evicted.
104 More options may be implemented in the future.
106 --condor-keep-files
110 (Specific option) Directs HTCondor to not remove temporary files
112 generated by condor_qsub , such as HTCondor submit files and sen‐
113 tinel jobs. These temporary files may be important for debugging.
114 -cwd
118 (Directory option) Specifies the initial directory in which the job
120 will run to be the current directory from which the job was submit‐
121 ted. This sets initialdir for condor_submit .
122 -d path or -wd path
126 (Directory option) Specifies the initial directory in which the job
128 will run to be path . This sets initialdir for condor_submit .
129 -e filename
133 (File option) Specifies the condor_submit command error , the file
135 where stderr is written. If not specified, set to the default name
136 of <commandfile>.e<ClusterId> , where <commandfile> is the con‐
137 dor_qsub argument, and <ClusterId> is the job attribute ClusterId
138 assigned for the job.
139 --f qsub_file
143 (Specific option) Parse qsub_file to search for and set additional
145 condor_submit commands. Within the file, commands will appear as
146 #PBS or #SGE . condor_qsub will parse the batch file listed as
147 qsub_file .
148 -h
152 (Status option) Placed submitted job directly into the hold state.
154 --help
158 (Specific option) Print usage information and exit.
160 -hold_jid <jid>
164 (Status option) Submits a job in the hold state. This job is
166 released only when a previously submitted job, identified by its
167 cluster ID as <jid> , exits successfully. Successful completion is
168 defined as not exiting with exit code 100. In implementation, there
169 are three jobs that define this SGE feature. The first job is the
170 previously submitted job. The second job is the newly submitted one
171 that is waiting for the first to finish successfully. The third job
172 is what SGE calls a sentinel job; this is an HTCondor local universe
173 job that watches the history for the first job's exit code. This
174 third job will exit once it has seen the exit code and, for a suc‐
175 cessful termination of the first job, run condor_release on the sec‐
176 ond job. If the first job is an array job, the second job will only
177 be released after all individual jobs of the first job have com‐
178 pleted.
179 -i [hostname:]filename
183 (File option) Specifies the condor_submit command input , the file
185 from which stdin is read.
186 -j characters
190 (File option) Acceptable characters for this option are e , o ,
192 and n . The only sequence that is relevant is eo ; it specifies
193 that both standard output and standard error are to be sent to the
194 same file. The file will be the one specified by the -o option, if
195 both the -o and -e options exist. The file will be the one specified
196 by the -e option, if only the -e option is provided. If neither the
197 -o nor the -e options are provided, the file will be the default
198 used for the -o option.
199 -l resource_spec
203 (Resource option) Specifies requirements for the job, such as the
205 amount of RAM and the number of CPUs. Only PBS-style resource
206 requests are supported. resource_spec is a comma separated list of
207 key/value pairs. Each pair is of the form resource_name=value .
208 resource_name and value may be
209 resource_name value DescriptionarchstringSets Arch machine
212 attribute. Enclose in double quotes.filesizeDisk space
213 requested.hoststringHost machine on which the job must run.mem‐
214 sizeAmount of memory requested.nodes {<node_count> | <hostname>}
215 [:ppn=<ppn>] [:gpus=<gpu>] [:<property> [:<property>] ...] [+ ...]
216 Number and/or properties of nodes to be used. For examples, please
217 see http://docs.adaptivecomputing.com/torque/4-1-3/Content/top‐
218 ics/2-jobs/requestingRes.htm#qsubopsysstringSets OpSys machine
219 attribute. Enclose in double quotes.procsintegerNumber of CPUs
220 requested.A size value is an integer specified in bytes, following
221 the PBS/Torque default. Append Kb , Mb , Gb , or Tb to specify
222 the value in powers of two quantities greater than bytes.
223 -m a|e|n
227 (Notification option) Identify when HTCondor sends notification e-
229 mail. If a , send e-mail when the job terminates abnormally. If e ,
230 send e-mail when the job terminates. If n , never send e-mail.
231 -M e-mail_address
235 (Notification option) Sets the destination address for HTCondor e-
237 mail.
238 -o filename
242 (File option) Specifies the condor_submit command output , the file
244 where stdout is written. If not specified, set to the default name
245 of <commandfile>.o<ClusterId> , where <commandfile> is the con‐
246 dor_qsub argument, and <ClusterId> is the job attribute ClusterId
247 assigned for the job.
248 -p integer
252 (Status option) Sets the priority submit command for the job, with 0
254 being the default. Jobs with higher numerical priority will run
255 before jobs with lower numerical priority.
256 --print
260 (Specific option) Send to stdout the contents of the HTCondor sub‐
262 mit description file that condor_qsub generates.
263 -r y|n
267 (Status option) The default value of y implements the default HTCon‐
269 dor policy of assuming that jobs that do not complete are placed
270 back in the queue to be run again. When n , job submission is
271 restricted to only running the job if the job ClassAd attribute
272 NumJobStarts is currently 0. This identifies the job as not re-
273 runnable, limiting it to start once.
274 -S shell
278 (Submission option) Specifies the path and executable name of a
280 shell. Alters the HTCondor submit description file produced, such
281 that the executable becomes a wrapper script. Within the submit
282 description file will be executable = <shell> and arguments =
283 <commandfile> .
284 -t start [-stop:step]
288 (Submission option) Queues a set of nearly identical jobs. The SGE-
290 style syntax is supported. start , stop , and step are all inte‐
291 gers. start is the starting index of the jobs, stop is the ending
292 index (inclusive) of the jobs, and step is the step size through the
293 indices. Note that using more than one processor or node in a job
294 will not work with this option.
295 --test
299 (Specific option) With the intention of testing a potential job sub‐
301 mission, parse files and commands to generate error output. Pro‐
302 duces, but then removes the HTCondor submit description file. Never
303 submits the job, even if no errors are encountered.
304 -v variable list
308 (Environmental option) Used to set the submit command environment
310 for the job. variable list is as that defined for the submit com‐
311 mand. Note that the syntax needed is specialized to deal with quote
312 marks and white space characters.
313 -V
317 (Environmental option) Sets getenv = True in the submit description
319 file.
320 -W attr_name=attr_value[,attr_name=attr_value...]
324 (File option) PBS/Torque supports a number of attributes. However,
326 condor_qsub only supports the names stagein and stageout for
327 attr_name . The format of attr_value for stagein and stageout is
328 local_file@hostname:remote_file[,...] and we strip it to
329 remote_file[,...] . HTCondor's file transfer mechanism is then used
330 if needed.
331 --version
335 (Specific option) Print version information for the condor_qsub pro‐
337 gram and exit. Note that condor_qsub has its own version numbers
338 which are separate from those of HTCondor.
339
343 condor_qsub will exit with a status value of 0 (zero) upon success, and
344 it will exit with the value 1 (one) upon failure to submit a job.
345
347 Center for High Throughput Computing, University of Wisconsin-Madison
348
350 Copyright (C) 1990-2018 Center for High Throughput Computing, Computer
351 Sciences Department, University of Wisconsin-Madison, Madison, WI. All
352 Rights Reserved. Licensed under the Apache License, Version 2.0.
353 date just-man-pages/condor_qsub(1)