Menu

Tree [c8a26c] master 0.25 /
 History

HTTPS access


File Date Author Commit
 src 2020-05-05 Radim Kolar Radim Kolar [fa1823] change version to 0.25
 .classpath 2009-10-20 hsn@sendmail.cz <> [7c92ed] FSP library removed from source code. Now it is...
 .gitignore 2020-04-27 Radim Kolar Radim Kolar [d4aaaa] .bzrignore renamed to .gitignore
 .project 2009-10-20 hsn@sendmail.cz <> [7c92ed] FSP library removed from source code. Now it is...
 NEWS 2020-05-05 Radim Kolar Radim Kolar [0d5eca] added one empty line for readability
 README.txt 2020-05-05 Radim Kolar Radim Kolar [0a282b] renamed to README.txt
 dmachine.cnf 2020-05-05 Radim Kolar Radim Kolar [4bdfbd] documented alive_flag
 pom.xml 2020-05-05 Radim Kolar Radim Kolar [cceb46] add gpg signing plugin
 zip.xml 2020-05-05 Radim Kolar Radim Kolar [c8a26c] do not include base directory in zip.

Read Me

                                Download Machine

          simple, non interactive, non graphical, batch download tool
              for FTP, FSP and HTTP downloads with resume support
                     Licensed as Open Source Software (GPL)

                         Radim Kolar (hsn@users.sourceforge.net)
                        http://dmachine.sourceforge.net/

How to use:
===========

0. You need to have java 5 or higher installed. Get OpenJDK from 
   https://adoptopenjdk.net/releases.html

1. Configure DMachine by editing dmachine.cnf.
Normally not needed unless you want to use proxy. See
http://dmachine.sourceforge.net/operation.html for details.

2. Run the background download daemon:
java -jar dmachine.jar

3. Put some URLs into queue file:

Default queue filename is 'queue', but it can be changed in dmachine.cnf, you
can even have multiple queue files watched for changes.

Open queue file with any ASCII editor and place required URL to it, one per line.
I use copy & paste between Firefox and text editor.

Smart Cache proxy server can be configured to write download requests to specified
queue file. See manual at http://scache.sourceforge.net for more details.

4. Save queue in editor and wait

5. Queue files are regularly checked by daemon, so you can add more URL to it and
save it.

6. DM has also drop directory support. This is a special directory; any
   file in this directory will be processed as queue and then deleted.

Special commands in queue file
==============================
Queue file is not just simple URL list one per line, there are also few
special commands for fine-tuning download operation. Queue files can
have comments, just place # at start of line.

1. Specifying an alternative URLs for file

Download Machine uses only filename part of URL. If you are place:

 http://www.server.com/file.zip (and)
 http://mirror.server.com/mirrored/file.zip

 into queue file, DM will think that these two are alternative URLs for the
 same file.

 If the same file is on the net with different filename you can use:
 http://www.server.com/stuff/file-1.2.3.zip#file123.zip
 http://www.server.org/stuff/file-123.zip#file123.zip

2. Custom Referer header

 Some servers checks Referer header. Download Machine sends fake Referer
 header, which works in most time, but sometimes you will need a custom
 Referer header.

 If you place into queue file:
 Referer http://216.42.31.135/ http://www.zephyr.com/
 every request to http://216.... will gets second (zephyr) URL as Referer.

3. Custom cookie header

  Some servers needs Cookie header to be sent. Cookies are often used for
  authorization purposes and sometimes server can refuse a download if
  no valid cookie was found in request. First argument is server name
  and second is cookie value in format name=value[; ...]

 cookie http://www.fileplanet.com/ auth=542345123456

4. Check also other directory if file is already downloaded

  check_also <regexp> <directory>

  example:
  check_also *.mp3 /home/hsn/mp3/Krishna_Das/

5. Save file to alternate directory

  save_to <regexp> <directory>

  example:
  save_to *.mp3 /home/hsn/mp3/Krishna_Das/

C/