Command Line Tools for Transferring Data

curl

curl

README - Everything curl

Get verbose information:

$ curl -v -I ⟨URL⟩

Download remote file:

$ curl --no-clobber -C -R -O -H "User-Agent:" ⟨URL⟩

--no-clobber : do not overwrite files that already exist,
-C : resume getting a partially-downloaded file
-O : write output to a file named as the remote file
-H "User-Agent:" : send empty User-Agent header. The default header value is 'curl/[version]'.

wget

Wget - GNU Project - Free Software Foundation

Wget Manual

Download remote file:

$ wget -c --user-agent "" ⟨URL⟩

-c : resume getting a partially-downloaded file

The Latest and Most Common User Agents List