Ad: I'm currently developing a new date and time library synchro for the modern era. please give it ⭐!!
Multi-Connection Download using parallel requests.
- Fast
- Resumable
- Cross-compiled (windows, linux, macOS)
This is an example to download linux kernel. It will be finished between 15s.
This program comes with no warranty. You must use this program at your own risk.
- Using a large number of connections to a single URL can lead to DOS attacks.
- The case is increasing that if you use multiple connections to 1 URL does not increase the download speed with the spread of CDNs.
- I recommend to use multiple mirrors simultaneously for faster downloads (And the number of connections is 1 for each).
$ brew install pget
$ go install github.com/Code-Hex/pget/cmd/pget@latest
This example will be used 2 connections per URL.
$ pget -p 2 MIRROR1 MIRROR2 MIRROR3
If you have created such as this file
cat list.txt
MIRROR1
MIRROR2
MIRROR3
You can do this
cat list.txt | pget -p 2
Options:
-h, --help print usage and exit
-p, --procs <num> the number of connections for a single URL (default 1)
-o, --output <filename> output file to <filename>
-t, --timeout <seconds> timeout of checking request in seconds
-u, --user-agent <agent> identify as <agent>
-r, --referer <referer> identify as <referer>
--check-update check if there is update available
--trace display detail error messages
URL: https://mirror.internet.asn.au/pub/ubuntu/releases/21.10/ubuntu-21.10-desktop-amd64.iso
Using
time wget https://mirror.internet.asn.au/pub/ubuntu/releases/21.10/ubuntu-21.10-desktop-amd64.iso
time pget -p 6 https://mirror.internet.asn.au/pub/ubuntu/releases/21.10/ubuntu-21.10-desktop-amd64.iso
Results
wget 3.92s user 23.52s system 3% cpu 13:35.24 total
pget -p 6 10.54s user 34.52s system 25% cpu 2:56.93 total
wget 13:35.24 total, pget -p 6 2:56.93 total (6x faster)
You can download from here