pytomo

Usage: start_crawl.py [-b --batch] [-u max_crawled_url] [-r max_rounds] [-l, --loop|--no-loop] [-R --related|--no-related] [-p max_per_url] [-P max_per_page] [-s {youtube, dailymotion}] [--snmp] [-t time_frame] [-n ping_packets] [-D download_time] [-S delay_between_requests] [-x, --no-log-ip] [-c, --no-centralize] [--http-proxy=http://proxy:8080] [--provider=MY_ISP] [--download-extra-dns] [-L log_level] [-f, --input_file input_file_list] [input_urls]