Search Results for "linux ftp"

Multi-connection command line tool to download Internet sites. Similar to wget and cURL, but it manages up to 50 parallel links. Main features are: recursive fetching, Metalink retrieving, segmented download and image filtering by width and height.

Fixed width data files are probably the most annoying data to import into database. This utility allows user to insert user-defined column separators into user-defided positions of flat file table given in fixed-width format. I am using this utility to import astronomical catalogs provided as flat tables at CDS ftp-server into postgresql; Build: $ make all [cc={icc|gcc}] Install: $ make install [prefix=/path/to/your/bin/directory] Example of usage: $ gzip -dc table.dat.gz |...

Methanol is a scriptable multi-purpose web crawling system with an extensible configuration system and speed-optimized architectural design. Methabot is the web crawler of Methanol.

A command line utility to display statistics about a text file consisting of lines of data. The statistics include counts of line terminator pairs (CR, LF, CR+LF) and line counts. Also shows if there is an unterminated trailing line.

mani-xml-stats is a useful utility that converts the mani_stats.dat file from the mani admin plugin into an xml file. It can use FTP to retrieve the stats file from a server and to upload the xml file to a server.