1qsub(1B) PBS qsub(1B)
2
3
4
6 qsub - submit pbs job
7
9 qsub [-a date_time] [-A account_string] [-b secs] [-c check‐
10 point_options] [-C directive_prefix] [-d path] [-D path] [-e path] [-f]
11 [-h] [-I] [-j join] [-k keep] [-l resource_list] [-m mail_options] [-M
12 user_list] [-n node exclusive] [-N name] [-o path] [-p priority] [-P
13 proxy_username[:group]] [-q destination] [-r c] [-S path_list] [-t
14 array_request] [-T prologue/epilogue script_name] [-u user_list] [-v
15 variable_list] [-V] [-w] path [-W additional_attributes] [-x] [-X] [-z]
16 [script]
17
19 To create a job is to submit an executable script to a batch server.
20 The batch server will be the default server unless the -q option is
21 specified. See discussion of PBS_DEFAULT under Environment Variables
22 below. Typically, the script is a shell script which will be executed
23 by a command shell such as sh or csh.
24
25 Options on the qsub command allow the specification of attributes which
26 affect the behavior of the job.
27
28 The qsub command will pass certain environment variables in the Vari‐
29 able_List attribute of the job. These variables will be available to
30 the job. The value for the following variables will be taken from the
31 environment of the qsub command: HOME, LANG, LOGNAME, PATH, MAIL,
32 SHELL, and TZ. These values will be assigned to a new name which is
33 the current name prefixed with the string "PBS_O_". For example, the
34 job will have access to an environment variable named PBS_O_HOME which
35 have the value of the variable HOME in the qsub command environment.
36
37 In addition to the above, the following environment variables will be
38 available to the batch job.
39
40 PBS_O_HOST
41 the name of the host upon which the qsub command is running.
42
43 PBS_SERVER
44 the hostname of the pbs_server which qsub submits the job to.
45
46 PBS_O_QUEUE
47 the name of the original queue to which the job was submitted.
48
49 PBS_O_WORKDIR
50 the absolute path of the current working directory of the qsub
51 command.
52
53 PBS_ARRAYID
54 each member of a job array is assigned a unique identifier (see
55 -t)
56
57 PBS_ENVIRONMENT
58 set to PBS_BATCH to indicate the job is a batch job, or to
59 PBS_INTERACTIVE to indicate the job is a PBS interactive job,
60 see -I option.
61
62 PBS_JOBID
63 the job identifier assigned to the job by the batch system.
64
65 PBS_JOBNAME
66 the job name supplied by the user.
67
68 PBS_NODEFILE
69 the name of the file contain the list of nodes assigned to the
70 job (for parallel and cluster systems).
71
72 PBS_QUEUE
73 the name of the queue from which the job is executed.
74
76 -a date_time
77 Declares the time after which the job is eligible for execu‐
78 tion.
79
80 The date_time argument is in the form:
81 [[[[CC]YY]MM]DD]hhmm[.SS]
82
83 Where CC is the first two digits of the year (the century), YY
84 is the second two digits of the year, MM is the two digits for
85 the month, DD is the day of the month, hh is the hour, mm is
86 the minute, and the optional SS is the seconds.
87
88 If the month, MM, is not specified, it will default to the cur‐
89 rent month if the specified day DD, is in the future. Other‐
90 wise, the month will be set to next month. Likewise, if the
91 day, DD, is not specified, it will default to today if the time
92 hhmm is in the future. Otherwise, the day will be set to
93 tomorrow. For example, if you submit a job at 11:15am with a
94 time of -a 1110, the job will be eligible to run at 11:10am
95 tomorrow.
96
97 -A account_string
98 Defines the account string associated with the job. The
99 account_string is an undefined string of characters and is
100 interpreted by the server which executes the job. See section
101 2.7.1 of the PBS ERS.
102
103 -b seconds
104 Defines the maximum number of seconds qsub will block attempt‐
105 ing to contact pbs_server. If pbs_server is down, or for a
106 variety of communication failures, qsub will continually retry
107 connecting to pbs_server for job submission. This value over‐
108 rides the CLIENTRETRY parameter in torque.cfg. This is a non-
109 portable TORQUE extension. Portability-minded users can use
110 the PBS_CLIENTRETRY environmental variable. A negative value
111 is interpreted as infinity. The default is 0.
112
113 -c checkpoint_options
114 Defines the options that will apply to the job. If the job
115 executes upon a host which does not support checkpoint, these
116 options will be ignored.
117
118 Valid checkpoint options are:
119
120 none
121 No checkpointing is to be performed.
122
123 enabled
124 Specify that checkpointing is allowed but must be explicitly
125 invoked by either the qhold or qchkpt commands.
126
127 shutdown
128 Specify that checkpointing is to be done on a job at pbs_mom
129 shutdown.
130
131 periodic
132 Specify that periodic checkpointing is enabled. The default
133 interval is 10 minutes and can be changed by the $check‐
134 point_interval option in the mom config file or by specify‐
135 ing an interval when the job is submitted
136
137 interval=minutes
138 Checkpointing is to be performed at an interval of minutes,
139 which is the integer number of minutes of wall time used by
140 the job. This value must be greater than zero.
141
142 depth=number
143 Specify a number (depth) of checkpoint images to be kept in
144 the checkpoint directory.
145
146 dir=path
147 Specify a checkpoint directory (default is
148 /var/spool/torque/checkpoint).
149
150 -C directive_prefix
151 Defines the prefix that declares a directive to the qsub com‐
152 mand within the script file. See the paragraph on script
153 directives in the Extended Description section.
154
155 If the -C option is presented with a directive_prefix argument
156 that is the null string, qsub will not scan the script file for
157 directives.
158
159 -d path Defines the working directory path to be used for the job. If
160 the -d option is not specified, the default working directory
161 is the home directory. This option sets the environment vari‐
162 able PBS_O_INITDIR.
163
164 -D path Defines the root directory to be used for the job. This option
165 sets the environment variable PBS_O_ROOTDIR.
166
167 -e path Defines the path to be used for the standard error stream of
168 the batch job. The path argument is of the form:
169 [hostname:][path_name]
170 where hostname is the name of a host to which the file will be
171 returned and path_name is the path name on that host in the
172 syntax recognized by POSIX. The argument will be interpreted
173 as follows:
174
175 path_name
176 Where path_name is not an absolute path name, then the
177 qsub command will expand the path name relative to the
178 current working directory of the command. The command
179 will supply the name of the host upon which it is exe‐
180 cuting for the hostname component.
181
182 hostname:path_name
183 Where path_name is not an absolute path name, then the
184 qsub command will not expand the path name relative to
185 the current working directory of the command. On deliv‐
186 ery of the standard error, the path name will be
187 expanded relative to the user's home directory on the
188 hostname system.
189
190 path_name
191 Where path_name specifies an absolute path name, then
192 the qsub will supply the name of the host on which it is
193 executing for the hostname
194
195 hostname:path_name
196 Where path_name specifies an absolute path name, the
197 path will be used as specified. hostname.
198
199 hostname:
200 Where hostname specifies the name of the host that the
201 file should be returned to. The path will be the default
202 file name.
203
204 If the -e option is not specified or the path_name is not spec‐
205 ified or is specified and is a directory, the default file name
206 for the standard error stream will be used. The default name
207 has the following form:
208 job_name.esequence_number
209 where job_name is the name of the job, see -N option, and
210 sequence_number is the job number assigned when the job is sub‐
211 mitted.
212
213 -f Specifies that the job is fault tolerant. The fault_tolerant
214 attribute will be set to true, which indicates that the job can
215 survive the loss of a mom other than the "mother superior" mom
216 (the first node in the exec hosts )
217
218 -h Specifies that a user hold be applied to the job at submission
219 time.
220
221 -I Declares that the job is to be run "interactively". The job
222 will be queued and scheduled as any PBS batch job, but when
223 executed, the standard input, output, and error streams of the
224 job are connected through qsub to the terminal session in which
225 qsub is running. Interactive jobs are forced to not rerunable.
226 See the "Extended Description" paragraph for addition informa‐
227 tion of interactive jobs.
228
229 -j join Declares if the standard error stream of the job will be merged
230 with the standard output stream of the job.
231
232 An option argument value of oe directs that the two streams
233 will be merged, intermixed, as standard output. An option
234 argument value of eo directs that the two streams will be
235 merged, intermixed, as standard error.
236
237 If the join argument is n or the option is not specified, the
238 two streams will be two separate files.
239
240 -k keep Defines which (if either) of standard output or standard error
241 will be retained on the execution host. If set for a stream,
242 this option overrides the path name for that stream. If not
243 set, neither stream is retained on the execution host.
244
245 The argument is either the single letter "e" or "o", or the
246 letters "e" and "o" combined in either order. Or the argument
247 is the letter "n".
248
249 e The standard error stream is to retained on the execution
250 host. The stream will be placed in the home directory of
251 the user under whose user id the job executed. The file
252 name will be the default file name given by: job_name.ese‐
253 quence where job_name is the name specified for the job, and
254 sequence is the sequence number component of the job identi‐
255 fier.
256
257 o The standard output stream is to retained on the execution
258 host. The stream will be placed in the home directory of
259 the user under whose user id the job executed. The file
260 name will be the default file name given by: job_name.ose‐
261 quence where job_name is the name specified for the job, and
262 sequence is the sequence number component of the job identi‐
263 fier.
264
265 eo Both the standard output and standard error streams will be
266 retained.
267
268 oe Both the standard output and standard error streams will be
269 retained.
270
271 n Neither stream is retained.
272
273 -l resource_list
274 Defines the resources that are required by the job and estab‐
275 lishes a limit to the amount of resource that can be consumed.
276 If not set for a generally available resource, such as CPU
277 time, the limit is infinite. The resource_list argument is of
278 the form:
279 resource_name[=[value]][,resource_name[=[value]],...]
280
281 -m mail_options
282 Defines the set of conditions under which the execution server
283 will send a mail message about the job. The mail_options argu‐
284 ment is a string which consists of either the single character
285 "n", or one or more of the characters "a", "b", and "e".
286
287 If the character "n" is specified, no mail will be sent.
288
289 For the letters "a", "b", and "e":
290
291 a mail is sent when the job is aborted by the batch system.
292
293 b mail is sent when the job begins execution.
294
295 e mail is sent when the job terminates.
296
297 If the -m option is not specified, mail will be sent if the job
298 is aborted.
299
300 -M user_list
301 Declares the list of users to whom mail is sent by the execu‐
302 tion server when it sends mail about the job.
303
304 The user_list argument is of the form:
305 user[@host][,user[@host],...]
306 If unset, the list defaults to the submitting user at the qsub
307 host, i.e. the job owner.
308
309 -n Specifies that the job has exclusive access to the nodes it is
310 executing on. This is intended to be used in conjunction with a
311 scheduler that enforces exclusive access, and it tells the
312 cpuset to give the job access to all of that node's resources.
313
314 -N name Declares a name for the job. The name specified may be up to
315 and including 15 characters in length. It must consist of
316 printable, non white space characters with the first character
317 alphabetic.
318
319 If the -N option is not specified, the job name will be the
320 base name of the job script file specified on the command line.
321 If no script file name was specified and the script was read
322 from the standard input, then the job name will be set to
323 STDIN.
324
325 -o path Defines the path to be used for the standard output stream of
326 the batch job. The path argument is of the form:
327 [hostname:][path_name]
328 where hostname is the name of a host to which the file will be
329 returned and path_name is the path name on that host in the
330 syntax recognized by POSIX. The argument will be interpreted
331 as follows:
332
333 path_name
334 Where path_name is not an absolute path name, then the
335 qsub command will expand the path name relative to the
336 current working directory of the command. The command
337 will supply the name of the host upon which it is exe‐
338 cuting for the hostname component.
339
340 hostname:path_name
341 Where path_name is not an absolute path name, then the
342 qsub command will not expand the path name relative to
343 the current working directory of the command. On deliv‐
344 ery of the standard output, the path name will be
345 expanded relative to the user's home directory on the
346 hostname system.
347
348 path_name
349 Where path_name specifies an absolute path name, then
350 the qsub will supply the name of the host on which it is
351 executing for the hostname
352
353 hostname:path_name
354 Where path_name specifies an absolute path name, the
355 path will be used as specified. hostname.
356
357 hostname:
358 Where hostname specifies the name of the host that the
359 file should be returned to. The path will be the default
360 file name.
361
362 If the -o option is not specified or the path_name is not spec‐
363 ified or is specified and is a directory, the default file name
364 for the standard output stream will be used. The default name
365 has the following form:
366 job_name.osequence_number
367 where job_name is the name of the job, see -N option, and
368 sequence_number is the job number assigned when the job is sub‐
369 mitted.
370
371 -p priority
372 Defines the priority of the job. The priority argument must be
373 a integer between -1024 and +1023 inclusive. The default is no
374 priority which is equivalent to a priority of zero.
375
376 -P proxy_user[:group]
377 Proxy user for whom the job should be submitted. This option
378 is only available for the super user.
379
380 -q destination
381 Defines the destination of the job. The destination names a
382 queue, a server, or a queue at a server.
383
384 The qsub command will submit the script to the server defined
385 by the destination argument. If the destination is a routing
386 queue, the job may be routed by the server to a new destina‐
387 tion.
388
389 If the -q option is not specified, the qsub command will submit
390 the script to the default server. See PBS_DEFAULT under the
391 Environment Variables section on this man page and the PBS ERS
392 section 2.7.4, "Default Server".
393
394 If the -q option is specified, it is in one of the following
395 three forms:
396 queue
397 @server
398 queue@server
399
400 If the destination argument names a queue and does not name a
401 server, the job will be submitted to the named queue at the
402 default server.
403
404 If the destination argument names a server and does not name a
405 queue, the job will be submitted to the default queue at the
406 named server.
407
408 If the destination argument names both a queue and a server,
409 the job will be submitted to the named queue at the named
410 server.
411
412 -r y|n Declares whether the job is rerunable. See the qrerun command.
413 The option argument is a single character, either y or n.
414
415 If the argument is "y", the job is rerunable. If the argument
416 is "n", the job is not rerunable. The default value is 'y',
417 rerunable.
418
419 -S path_list
420 Declares the shell that interprets the job script.
421
422 The option argument path_list is in the form:
423 path[@host][,path[@host],...]
424 Only one path may be specified for any host named. Only one
425 path may be specified without the corresponding host name. The
426 path selected will be the one with the host name that matched
427 the name of the execution host. If no matching host is found,
428 then the path specified without a host will be selected, if
429 present.
430
431 If the -S option is not specified, the option argument is the
432 null string, or no entry from the path_list is selected, the
433 execution will use the user's login shell on the execution
434 host.
435
436 -t array_request
437 Specifies the task ids of a job array. Single task arrays are
438 allowed.
439
440 The array_request argument is an integer id or a range of inte‐
441 gers. Multiple ids or id ranges can be combined in a comma
442 delimted list. Examples : -t 1-100 or -t 1,10,50-100
443
444 An optional slot limit can be specified to limit the amount of
445 jobs that can run concurrently in the job array. The default
446 value is unlimited. The slot limit must be the last thing spec‐
447 ified in the array_request and is delimited from the array by a
448 percent sign (%).
449
450 qsub script.sh -t 0-299%5
451
452 This sets the slot limit to 5. Only 5 jobs from this array can
453 run at the same time.
454
455 Note: You can use qalter to modify slot limits on an array. The
456 server parameter max_slot_limit can be used to set a global
457 slot limit policy.
458
459 -T script_name
460 Allows for per job prologue and epilogue scripts. The full
461 script name will be prologue.[name] or epilogue.[name]. For the
462 job submission, only request the name of the prologue or epi‐
463 logue script.
464
465 Example: qsub -T prescript
466 Specifies to use the script prologue.prescript
467
468 -u user_list
469 Defines the user name under which the job is to run on the exe‐
470 cution system.
471
472 The user_list argument is of the form:
473 user[@host][,user[@host],...]
474 Only one user name may be given per specified host. Only one
475 of the user specifications may be supplied without the corre‐
476 sponding host specification. That user name will used for exe‐
477 cution on any host not named in the argument list. If unset,
478 the user list defaults to the user who is running qsub.
479
480 -v variable_list
481 Expands the list of environment variables that are exported to
482 the job.
483
484 In addition to the variables described in the "Description"
485 section above, variable_list names environment variables from
486 the qsub command environment which are made available to the
487 job when it executes. The variable_list is a comma separated
488 list of strings of the form variable or variable=value. These
489 variables and their values are passed to the job.
490
491 -V Declares that all environment variables in the qsub command's
492 environment are to be exported to the batch job.
493
494 -w path Defines the working directory path to be used for the job. If
495 the -w option is not specified, the default working directory
496 is the current directory. This option sets the environment
497 variable PBS_O_WORKDIR.
498
499 -W additional_attributes
500 The -W option allows for the specification of additional job
501 attributes. The general syntax of the -W is in the form:
502 -W attr_name=attr_value[,attr_name=attr_value...]
503 Note if white space occurs anywhere within the option argument
504 string or the equal sign, "=", occurs within an attribute_value
505 string, then the string must be enclosed with either single or
506 double quote marks.
507
508 PBS currently supports the following attributes within the -W
509 option.
510
511 depend=dependency_list
512 Defines the dependency between this and other jobs. The depen‐
513 dency_list is in the form:
514 type[:argument[:argument...][,type:argument...].
515 The argument is either a numeric count or a PBS job id accord‐
516 ing to type . If argument is a count, it must be greater than
517 0. If it is a job id and not fully specified in the form
518 seq_number.server.name, it will be expanded according to the
519 default server rules which apply to job IDs on most commands.
520 If argument is null (the preceding colon need not be speci‐
521 fied), the dependency of the corresponding type is cleared
522 (unset).
523
524 synccount:count
525 This job is the first in a set of jobs to be executed
526 at the same time. Count is the number of additional
527 jobs in the set.
528
529 syncwith:jobid
530 This job is an additional member of a set of jobs to be
531 executed at the same time. In the above and following
532 dependency types, jobid is the job identifier of the
533 first job in the set.
534
535 after:jobid[:jobid...]
536 This job may be scheduled for execution at any point
537 after jobs jobid have started execution.
538
539 afterok:jobid[:jobid...]
540 This job may be scheduled for execution only after jobs
541 jobid have terminated with no errors. See the csh
542 warning under "Extended Description".
543
544 afternotok:jobid[:jobid...]
545 This job may be scheduled for execution only after jobs
546 jobid have terminated with errors. See the csh warning
547 under "Extended Description".
548
549 afterany:jobid[:jobid...]
550 This job may be scheduled for execution after jobs
551 jobid have terminated, with or without errors.
552
553 on:count
554 This job may be scheduled for execution after count
555 dependencies on other jobs have been satisfied. This
556 form is used in conjunction with one of the before
557 forms, see below.
558
559 before:jobid[:jobid...]
560 When this job has begun execution, then jobs jobid...
561 may begin.
562
563 beforeok:jobid[:jobid...]
564 If this job terminates execution without errors, then
565 jobs jobid... may begin. See the csh warning under
566 "Extended Description".
567
568 beforenotok:jobid[:jobid...]
569 If this job terminates execution with errors, then jobs
570 jobid... may begin. See the csh warning under
571 "Extended Description".
572
573 beforeany:jobid[:jobid...]
574 When this job terminates execution, jobs jobid... may
575 begin.
576
577 If any of the before forms are used, the jobs refer‐
578 enced by jobid must have been submitted with a depen‐
579 dency type of on.
580
581 Array Dependencies
582 It is now possible to have a job depend on an array.
583 These dependencies are in the form depend=array‐
584 dep:arrayid[num]. If [num] is not present, then the
585 dependencies applies to the entire array. If [num] is
586 present, then num means the number of jobs that must
587 meet the condition for the dependency to be satisfied.
588
589 afterstartarray:arrayid[count]
590 This job may be scheduled for execution only after jobs
591 in arrayid have started execution.
592
593 afterokarray:arrayid[count]
594 This job may be scheduled for execution only after jobs
595 in arrayid have terminated with no errors.
596
597 afternotok:arrayid[count]
598 This job may be scheduled for execution only after jobs
599 in arrayid have terminated with errors.
600
601 afteranyarray:arrayid[count]
602 This job may be scheduled for execution after jobs in
603 array id have terminated, with or without errors.
604
605 beforestartarray:arrayid[count]
606 This job may be scheduled for execution only before
607 jobs in arrayid have started execution.
608
609 beforeokarray:arrayid[count]
610 This job may be scheduled for execution only before
611 jobs in arrayid have terminated with no errors.
612
613 beforenotok:arrayid[count]
614 This job may be scheduled for execution only before
615 jobs in arrayid have terminated with errors.
616
617 beforeanyarray:arrayid[count]
618 This job may be scheduled for execution before jobs in
619 array id have terminated, with or without errors.
620
621 If any of the before forms are used, the jobs refer‐
622 enced by jobid must have the same owner as the job
623 being submitted. Otherwise, the dependency is ignored.
624
625 Error processing of the existence, state, or condition of
626 the job on which the newly submitted job is a deferred ser‐
627 vice, i.e. the check is performed after the job is queued.
628 If an error is detected, the new job will be deleted by the
629 server. Mail will be sent to the job submitter stating the
630 error.
631
632 Dependency examples:
633 qsub -W depend=afterok:123.big.iron.com /tmp/script
634 qsub -W depend=before:234.hunk1.com:235.hunk1.com
635 /tmp/script
636 qsub -W depend=afterokarray:21.tom.com[] /tmp/script
637 qsub -W depend=beforenotokarray:22.tom.com[][5] /tmp/script
638
639 group_list=g_list
640 Defines the group name under which the job is to run on the
641 execution system. The g_list argument is of the form:
642 group[@host][,group[@host],...]
643 Only one group name may be given per specified host. Only one
644 of the group specifications may be supplied without the corre‐
645 sponding host specification. That group name will used for
646 execution on any host not named in the argument list. If not
647 set, the group_list defaults to the primary group of the user
648 under which the job will be run.
649
650 interactive=true
651 If the interactive attribute is specified, the job is an inter‐
652 active job. The -I option is a alternative method of specify‐
653 ing this attribute.
654
655 stagein=file_list
656 stageout=file_list
657 Specifies which files are staged (copied) in before job start
658 or staged out after the job completes execution. On completion
659 of the job, all staged-in and staged-out files are removed from
660 the execution system. The file_list is in the form
661 local_file@hostname:remote_file[,...]
662 regardless of the direction of the copy. The name local_file
663 is the name of the file on the system where the job executed.
664 It may be an absolute path or relative to the home directory of
665 the user. The name remote_file is the destination name on the
666 host specified by hostname. The name may be absolute or rela‐
667 tive to the user's home directory on the destination host. The
668 use of wildcards in the file name is not recommended. The file
669 names map to a remote copy program (rcp) call on the execution
670 system in the follow manner:
671 For stagein: rcp hostname:remote_file local_file
672 For stageout: rcp local_file hostname:remote_file
673 Data staging examples:
674 -W stagein=/tmp/input.txt@headnode:/home/user/input.txt
675 -W stageout=/tmp/output.txt@headnode:/home/user/output.txt
676 If TORQUE has been compiled with wordexp support, then vari‐
677 ables can be used in the specified paths. Currently only
678 $PBS_JOBID, $HOME, and $TMPDIR are supported for stagein.
679
680 umask=XXX
681 Sets umask used to create stdout and stderr spool files in
682 pbs_mom spool directory. Values starting with 0 are treated as
683 octal values, otherwise the value is treated as a decimal umask
684 value.
685
686 -x When running an interactive job, the -x flag makes it so that
687 the script won't be parsed for PBS directives, but instead will
688 be a command that is launched once the interactive job has
689 started. The job will terminate at the completion of this com‐
690 mand.
691
692 -X Enables X11 forwarding. The DISPLAY environment variable must
693 be set.
694
695 -z Directs that the qsub command is not to write the job identi‐
696 fier assigned to the job to the command's standard output.
697
699 The qsub command accepts a script operand that is the path to the
700 script of the job. If the path is relative, it will be expanded rela‐
701 tive to the working directory of the qsub command.
702
703 If the script operand is not provided or the operand is the single
704 character "-", the qsub command reads the script from standard input.
705 When the script is being read from Standard Input, qsub will copy the
706 file to a temporary file. This temporary file is passed to the library
707 interface routine pbs_submit. The temporary file is removed by qsub
708 after pbs_submit returns or upon the receipt of a signal which would
709 cause qsub to terminate.
710
712 The qsub command reads the script for the job from standard input if
713 the script operand is missing or is the single character "-".
714
716 The script file is read by the qsub command. Qsub acts upon any direc‐
717 tives found in the script.
718
719 When the job is created, a copy of the script file is made and that
720 copy cannot be modified.
721
723 Unless the -z option is set, the job identifier assigned to the job
724 will be written to standard output if the job is successfully created.
725
727 The qsub command will write a diagnostic message to standard error for
728 each error occurrence.
729
731 The values of some or all of the variables in the qsub command's envi‐
732 ronment are exported with the job, see the -v and -V options.
733
734 The environment variable PBS_DEFAULT defines the name of the default
735 server. Typically, it corresponds to the system name of the host on
736 which the server is running. If PBS_DEFAULT is not set, the default is
737 defined by an administrator established file.
738
739 The environment variable PBS_DPREFIX determines the prefix string which
740 identifies directives in the script.
741
742 The environment variable PBS_CLIENTRETRY defines the maximum number of
743 seconds qsub will block. See the -b option above. Despite the name,
744 currently qsub is the only client that supports this option.
745
747 The torque.cfg file, located in PBS_SERVER_HOME (/var/spool/torque by
748 default) controls the behavior of the qsub command. This file contains
749 a list of parameters and values separated by whitespace
750
751 QSUBSLEEP takes an integer operand which specifies time to sleep when
752 running qsub command. Used to prevent users from overwhelming the
753 scheduler.
754
755 SUBMITFILTER specifies the path to the submit filter used to pre-
756 process job submission. The default path is $(libexecdir)/qsub_filter,
757 which falls back to /usr/local/sbin/torque_submitfilter for backwards
758 compatibility. This torque.cfg parameter overrides this default.
759
760 SERVERHOST specifies the value for the PBS_SERVER environment variable
761
762 QSUBHOST specifies the hostname for the jobs QSUB_O_HOST variable
763
764 QSUBSENDUID specifies a uid to use for the jobs PBS_O_UID variable
765
766 XAUTHPATH specifies the path to xauth
767
768 CLIENTRETRY specifies the integer seconds between retry attempts to
769 communicate with pbs_server
770
771 VALIDATEGROUP set this parameter to force qsub to verify the submit‐
772 ter's group id
773
774 DEFAULTCKPT specifies the default value for the jobs checkpoint
775 attribute. The user overrides this with the -c qsub option.
776
777 VALIDATEPATH set this parameter to force qsub to validate local exis‐
778 tence of a "-d" working directory
779
780 RERUNNABLEBYDEFAULT this parameter specifies if a job is rerunnable by
781 default. The default is true, setting this to false causes the
782 rerunnable attribute value to be false unless the users specifies oth‐
783 erwise with the -r option
784
785 FAULT_TOLERANT_BY_DEFAULT this parameter specifies if a job is fault
786 tolerant by default. The default value for the fault_tolerant job
787 attribute is false, setting this parameter to true causes the default
788 value of the attribute to be true. The user can specify their prefer‐
789 ence with the -f qsub option.
790
791 For example:
792 QSUBSLEEP 2
793 RERUNNABLEBYDEFAULT false
794
795
797 Script Processing:
798
799 A job script may consist of PBS directives, comments and executable
800 statements. A PBS directive provides a way of specifying job
801 attributes in addition to the command line options. For example:
802 :
803 #PBS -N Job_name
804 #PBS -l walltime=10:30,mem=320kb
805 #PBS -m be
806 #
807 step1 arg1 arg2
808 step2 arg3 arg4
809
810
811 The qsub command scans the lines of the script file for directives. An
812 initial line in the script that begins with the characters "#!" or the
813 character ":" will be ignored and scanning will start with the next
814 line. Scanning will continue until the first executable line, that is
815 a line that is not blank, not a directive line, nor a line whose first
816 non white space character is "#". If directives occur on subsequent
817 lines, they will be ignored.
818
819 A line in the script file will be processed as a directive to qsub if
820 and only if the string of characters starting with the first non white
821 space character on the line and of the same length as the directive
822 prefix matches the directive prefix.
823
824 The remainder of the directive line consists of the options to qsub in
825 the same syntax as they appear on the command line. The option charac‐
826 ter is to be preceded with the "-" character.
827
828 If an option is present in both a directive and on the command line,
829 that option and its argument, if any, will be ignored in the directive.
830 The command line takes precedence.
831
832 If an option is present in a directive and not on the command line,
833 that option and its argument, if any, will be processed as if it had
834 occurred on the command line.
835
836 The directive prefix string will be determined in order of preference
837 from:
838
839 The value of the -C option argument if the option is specified on
840 the command line.
841
842 The value of the environment variable PBS_DPREFIX if it is defined.
843
844 The four character string #PBS.
845
846 If the -C option is found in a directive in the script file, it will be
847 ignored.
848
849 User Authorization:
850
851 When the user submits a job from a system other than the one on which
852 the PBS Server is running, the name under which the job is to be exe‐
853 cuted is selected according to the rules listed under the -u option.
854 The user submitting the job must be authorized to run the job under the
855 execution user name. This authorization is provided if
856
857 (1) The host on which qsub is run is trusted by the execution
858 host (see /etc/hosts.equiv),
859
860 (2) The execution user has an .rhosts file naming the submit‐
861 ting user on the submitting host.
862
863 C-Shell .logout File:
864
865 The following warning applies for users of the c-shell, csh. If the
866 job is executed under the csh and a .logout file exists in the home
867 directory in which the job executes, the exit status of the job is that
868 of the .logout script, not the job script. This may impact any inter-
869 job dependencies. To preserve the job exit status, either remove the
870 .logout file or place the following line as the first line in the
871 .logout file
872 set EXITVAL = $status
873 and the following line as the last executable line in .logout
874 exit $EXITVAL
875
876 Interactive Jobs:
877
878 If the -I option is specified on the command line or in a script direc‐
879 tive, or if the "interactive" job attribute declared true via the -W
880 option, -W interactive=true, either on the command line or in a script
881 directive, the job is an interactive job. The script will be processed
882 for directives, but will not be included with the job. When the job
883 begins execution, all input to the job is from the terminal session in
884 which qsub is running.
885
886 When an interactive job is submitted, the qsub command will not termi‐
887 nate when the job is submitted. Qsub will remain running until the job
888 terminates, is aborted, or the user interrupts qsub with an SIGINT (the
889 control-C key). If qsub is interrupted prior to job start, it will
890 query if the user wishes to exit. If the user response "yes", qsub
891 exits and the job is aborted.
892
893 Once the interactive job has started execution, input to and output
894 from the job pass through qsub. Keyboard generated interrupts are
895 passed to the job. Lines entered that begin with the tilde ('~') char‐
896 acter and contain special sequences are escaped by qsub. The recog‐
897 nized escape sequences are:
898
899 ~. Qsub terminates execution. The batch job is also termi‐
900 nated.
901
902 ~susp Suspend the qsub program if running under the C shell.
903 "susp" is the suspend character, usually CNTL-Z.
904
905 ~asusp Suspend the input half of qsub (terminal to job), but
906 allow output to continue to be displayed. Only works
907 under the C shell. "asusp" is the auxiliary suspend
908 character, usually CNTL-Y.
909
911 Upon successful processing, the qsub exit status will be a value of
912 zero.
913
914 If the qsub command fails, the command exits with a value greater than
915 zero.
916
918 qalter(1B), qdel(1B), qhold(1B), qmove(1B), qmsg(1B), qrerun(1B),
919 qrls(1B), qselect(1B), qsig(1B), qstat(1B), pbs_connect(3B),
920 pbs_job_attributes(7B), pbs_queue_attributes(7B),
921 pbs_resources_irix5(7B), pbs_resources_sp2(7B),
922 pbs_resources_sunos4(7B), pbs_resources_unicos8(7B),
923 pbs_server_attributes(7B), and pbs_server(8B)
924
925
926
927
928Local qsub(1B)