A Web application to search for files on FTP servers. Users can query files by part of the file name, the entire file name, a regularexpression, or a shell pattern. To store file indexes, PostgreSQL or MySQL is used.
wget_worker is a Perl script that uses wget to download from the Web in parallel. It supports URL filtering to download only URLs that match your pattern specified by Perl's regularexpression.