Attila Fekete - 2012-05-24

FILE TYPES AND THEIR FORMATS

txt file

Used for lst generation, uses LstGenerator.
Format:
<prefix>(*<decimals>*<start>*<end>*<suffixprefix>)*

lst file

Generates anything or LstCreator, uses anything or Lst2Dow
Format:
<url>

l2d file

Generates user, uses Lst2Dow.
Format:
org.afekete.lst2dow.opt.separators=https://www.*http://www.*https://*http://*ftp://*www.*/*\\
org.afekete.lst2dow.opt.sort.by.variable.frequency=true
org.afekete.lst2dow.opt.vertical.expand=true
org.afekete.lst2dow.opt.download.path.file.separator=\\
Note:
separators are strings, delimiter: *.

dow file

Generates Lst2Dow, uses Downloader.
Format:
<url>*<relative_save_path>

sit file

Generates user, uses Downloader. Valid only with the related dow file.
If referer is not constant down must be homogenous (each download the same number of slash separators).
Format:
user=CONSTANT|<empty>
pass=CONSTANT|<empty>
referer=http://website.com/<rsp2>/<rsp3>/index.html|CONSTANT|<empty>
cookie=CONSTANT|<empty>

opt file

Generates user, uses Downloader.
destination=CONSTANT|<empty> e.g. C:\Downloads
proxy.server=CONSTANT|<empty>
proxy.port=CONSTANT|<empty>
proxy.user=CONSTANT|<empty>
proxy.pass=CONSTANT|<empty>


APPLICATIONS AND THEIR INPUT OUTPUT

LstGenerator

Gets txt files path, txt filename(s) (filename may contain wildcards,
multiple files are allowed from the same path) as input and
generates lst files with name prefix(_prefixsuffix)*.
If file with the same name already exists it appends that file.

Usage:
java -jar LstGenerator.jar -p path -f filen*me.txt

Lst2Dow

Gets l2d file first for conversion options, lst files ABSOLUTE path,
lst filename(s) (filename may contain wildcards, multiple files are allowed
from the same path) as input and generates dow files with the same name.

Usage:
java -jar Lst2Dow.jar -o file.l2d -p path -f filen*ame.lst

Downloader

Gets opt file for download options, sit file for website options, dow files path,
dow filename(s) (filename may contain wildcards, multiple files are allowed
from the same path)

Add functionality to download lst file.

Usage:
java -jar Downloader.jar -o file.opt -s file.sit -p path -f filen*me.dow
java -jar Downloader.jar -o file.opt -s file.sit -p path -f filen*me.lst

 

Last edit: Attila Fekete 2012-05-24