Search Results for "multi threaded"

Lux is an open source command-line tool designed for downloading videos from a wide variety of online media platforms. Written in the Go programming language, the project focuses on providing a fast and lightweight downloader that can retrieve media content directly from supported websites. Lux works by extracting video information from a given page and downloading the available streams to the user’s system. Lux supports downloading individual videos as well as playlists and can display...

spider_collection is a collection of Python web crawler scripts created primarily for experimentation, learning, and practical scraping tasks. spider_collection gathers multiple independent spiders designed to collect data from different platforms and services, demonstrating a variety of scraping techniques and workflows. These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages....

OpenWebSpider is an Open Source multi-threaded Web Spider (robot, crawler) and search engine with a lot of interesting features!

...Things have change so much since this was an original idea back then. Now you can find much better downloaders for various hosts and almost any platform and architecture. Thank you all for using it back then! ;) Description: A multi-threaded downloader with web interface that supports rapidshare.com, netload.in and hotfile.com services. Originally created for WD's MBWE but it can be used with any linux distro. It can be fully controlled remotely from it's web-interface