1GLOBUS-URL-COPY(1) Globus Tookit GLOBUS-URL-COPY(1)
2
6 globus-url-copy - globus-url-copy
7
9 /usr/bin/globus-url-copy [options]
10
12 globus-url-copy is a scriptable command line tool that can do
13 multi-protocol data movement. It supports gsiftp:// (GridFTP), ftp://,
14 http://, https://, and file:/// protocol specifiers in the URL. For
15 GridFTP, globus-url-copy supports all implemented functionality.
16 Versions from GT 3.2 and later support file globbing and directory
17 moves.
18
20 -help | -usage
21 Print help.
22 -versions
24 Print the versions of all modules that this program uses
25 -c | -continue-on-error
27 Do not die after any errors. By default, program will exit after
28 most errors.
29 -a | -ascii
31 Convert the file to/from ASCII format to/from local file format
32 -b | -binary
34 Do not apply any conversion to the files. *default*
35 -f filename
37 Read a list of url pairs from filename. Each line should contain
38 sourceURL destURL. Enclose URLs with spaces in double qoutes (").
39 Blank lines and lines beginning with # will be ignored.
40 -cd | -create-dest
42 Create destination directory if needed.
43 -r
45 Copy files in subdirectories
46 -fast
48 Recommended when using GridFTP servers. Use MODE E for all data
49 transfers, including reusing data channels between list and
50 transfer operations.
51 -t transfer time in seconds
53 Run the transfer for this number of seconds and then end. Useful
54 for performance testing or forced restart loops.
55 -q | -quiet
57 Suppress all output for successful operation
58 -v | -verbose
60 Display urls being transferred
61 -vb | -verbose-perf
63 During the transfer, display the number of bytes transferred and
64 the transfer rate per second. Show urls being transferred
65 -dbg | -debugftp
67 Debug ftp connections. Prints control channel communication to
68 stderr
69 -rst | -restart
71 Restart failed ftp operations.
72 -rst-retries retries
74 The maximum number of times to retry the operation before giving up
75 on the transfer. Use 0 for infinite. Default is 5.
76 -rst-interval seconds
78 The interval in seconds to wait after a failure before retrying the
79 transfer. Use 0 for an exponential backoff. Default is 0.
80 -rst-timeout seconds
82 Maximum time after a failure to keep retrying. Use 0 for no
83 timeout. Default is 0.
84 -stall-timeout | -st seconds
86 How long before cancelling/restarting a transfer with no data
87 movement. Set to 0 to disable. Default is 600 seconds.
88 -df filename | -dumpfile filename
90 Path to file where untransferred urls will be saved for later
91 restarting. Resulting file is the same format as the -f input file.
92 If file exists, it will be read and all other url input will be
93 ignored.
94 -do filename | -dump-only filename
96 Perform no write operations on the destination. Instead, all files
97 that would be transferred are enumerated and dumped to the
98 specified file. Resulting file is the same format as the -f input
99 file. Note: if you intend to use this file as input for a future
100 transfer, the -create-dest option will be required if any
101 destination directories do not already exist.
102 -rp | -relative-paths
104 The path portion of ftp urls will be interpereted as relative to
105 the user's starting directory on the server. By default, all paths
106 are root-relative. When this flag is set, the path portion of the
107 ftp url must start with %2F if it designates a root-relative path.
108 -s subject | -subject subject
110 Use this subject to match with both the source and dest servers
111 -ss subject | -source-subject subject
113 Use this subject to match with the source server
114 -ds subject | -dest-subject subject
116 Use this subject to match with the destionation server
117 -tcp-bs size | -tcp-buffer-size size
119 Specify the size (in bytes) of the buffer to be used by the
120 underlying ftp data channels.
121 -bs block size | -block-size block size
123 Specify the size (in bytes) of the buffer to be used by the
124 underlying transfer methods
125 -p parallelism | -parallel parallelism
127 Specify the number of parallel data connections should be used.
128 -notpt | -no-third-party-transfers
130 Turn third-party transfers off (on by default).
131 -nodcau | -no-data-channel-authentication
133 Turn off data channel authentication for ftp transfers.
134 -dcsafe | -data-channel-safe
136 Set data channel protection mode to SAFE
137 -dcpriv | -data-channel-private
139 Set data channel protection mode to PRIVATE
140 -off | -partial-offset
142 Offset for partial ftp file transfers, defaults to 0
143 -len | -partial-length
145 Length for partial ftp file transfers, used only for the source
146 url, defaults the full file.
147 --list url to list
149 -stripe
151 Enable striped transfers on supported servers
152 -striped-block-size | -sbs
154 Set layout mode and blocksize for striped transfers. If not set,
155 server defaults will be used. If set to 0, Partitioned mode will be
156 used. If set to >0, Blocked mode will be used, with this as the
157 blocksize.
158 -ipv6
160 Use ipv6 when available (EXPERIMENTAL)
161 -udt
163 Use UDT, a reliable udp based transport protocol, for data
164 transfers
165 -g2 | -gridftp2
167 Use GridFTP v2 protocol enhancements when possible
168 -dp | -delayed-pasv
170 Enable delayed passive
171 -mn | -module-name gridftp storage module name
173 Set the backend storage module to use for both the source and
174 destination in a GridFTP transfer
175 -mp | -module-parameters gridftp storage module parameters
177 Set the backend storage module arguments to use for both the source
178 and destination in a GridFTP transfer
179 -smn | -src-module-name gridftp storage module name
181 Set the backend storage module to use for the source in a GridFTP
182 transfer
183 -smp | -src-module-parameters gridftp storage module parameters
185 Set the backend storage module arguments to use for the source in a
186 GridFTP transfer
187 -dmn | -dst-module-name gridftp storage module name
189 Set the backend storage module to use for the destination in a
190 GridFTP transfer
191 -dmp | -dst-module-parameters gridftp storage module parameters
193 Set the backend storage module arguments to use for the destination
194 in a GridFTP transfer
195 -aa | -authz-assert authorization assertion file
197 Use the assertions in this file to authorize the access with both
198 source and dest servers
199 -saa | -src-authz-assert authorization assertion file
201 Use the assertions in this file to authorize the access with source
202 server
203 -daa | -dst-authz-assert authorization assertion file
205 Use the assertions in this file to authorize the access with dest
206 server
207 -cache-aa | -cache-authz-assert
209 Cache the authz assertion for subsequent transfers
210 -cache-saa | -cache-src-authz-assert
212 Cache the src authz assertion for subsequent transfers
213 -cache-daa | -cache-dst-authz-assert
215 Cache the dst authz assertion for subsequent transfers
216 -pipeline | -pp
218 Enable pipelining support for multi-file ftp transfers. Currently
219 third-party transfers benefit from this. *EXPERIMENTAL*
220 -concurrency | -cc
222 Number of concurrent ftp connections to use for multiple transfers.
223 -nl-bottleneck | -nlb
225 Use NetLogger to estimate speeds of disk and network read/write
226 system calls, and attempt to determine the bottleneck component
227 -src-pipe | -SP command line
229 Set the source end of a remote transfer to use piped in input with
230 the given command line. Do not use with -fsstack
231 -dst-pipe | -DP command line
233 Set the destination end of a remote transfer to write data to then
234 standard input of the program run via the given command line. Do
235 not use with -fsstack
236 -pipe command line
238 Sets both -src-pipe and -dst-pipe to the same thing.
239 -dcstack | -data-channel-stack
241 Set the XIO driver stack for the network on both the source and the
242 destination. Both must be GridFTP servers.
243 -fsstack | -file-system-stack
245 Set the XIO driver stack for the disk on both the source and the
246 destination. Both must be GridFTP servers.
247 -src-dcstack | -source-data-channel-stack
249 Set the XIO driver stack for the network on the source GridFTP
250 server.
251 -src-fsstack | -source-file-system-stack.
253 Set the XIO driver stack for the disk on the source GridFTP server.
254 -dst-dcstack | -dest-data-channel-stack
256 Set the XIO driver stack for the network on the destination GridFTP
257 server.
258 -dst-fsstack | -dest-file-system-stack
260 Set the XIO driver stack for the disk on the destination GridFTP
261 server.
262 -cred path to credentials or proxy file
264 Set the credentials to use for both ftp connections.
265 -src-cred | -sc path to credentials or proxy file
267 Set the credentials to use for source ftp connections.
268 -dst-cred | -dc path to credentials or proxy file
270 Set the credentials to use for destination ftp connections.
271 -af filename | -alias-file filename
273 File with mapping of logical host aliases to lists of physical
274 hosts. When used with multiple conncurrent connections, each
275 connection uses the next host in the list. Each line should either
276 be an alias, noted with the @ symbol, or a hostname[:port].
277 Currently, only the aliases @source and @destination are valid, and
278 they are used for every source or destination url.
279 -sync
281 Only transfer files where the destination does not exist or differs
282 from the source. -sync-level controls how to determine if files
283 differ.
284 -sync-level number
286 Choose critera for determining if files differ when performing a
287 sync transfer. Level 0 will only transfer if the destination does
288 not exist. Level 1 will transfer if the size of the destination
289 does not match the size of the source. Level 2 will transfer if the
290 timestamp of the destination is older than the timestamp of the
291 source. Level 3 will perform a checksum of the source and
292 destination and transfer if the checksums do not match. The default
293 sync level is 2.
294
296 The Globus Alliance, http://www.globus.org/
297 Author.
298
300 Copyright © 1999-2010 University of Chicago
301The Globus Alliance 08/11/2011 GLOBUS-URL-COPY(1)