Search Results for "spider"

A visual code-free/no-code web crawler/spider, supporting both Chinese and English.

Most powerful, popular and production crawling/scraping package for Node, happy hacking.

spider_collection is a collection of Python web crawler scripts created primarily for experimentation, learning, and practical scraping tasks. spider_collection gathers multiple independent spiders designed to collect data from different platforms and services, demonstrating a variety of scraping techniques and workflows. These crawlers make use of common Python scraping tools such as requests, parsel, BeautifulSoup, and the Scrapy framework to extract structured information from web pages....

DotnetSpider is a web crawling and data extraction framework built on the .NET Standard platform. It is designed to help developers create efficient and scalable crawlers for collecting structured data from websites. It provides a high-level API that simplifies the process of defining spiders, managing requests, and extracting content from web pages. Developers can create custom spiders by extending base classes and configuring pipelines that handle downloading, parsing, and storing...

...The project was open-sourced to support technical exchange and learning around distributed hash table crawling and search applications. Its history includes earlier Django-based work and a later Node.js rewrite. The repository includes crawler-related code under a spider directory, reflecting its emphasis on collecting and indexing distributed network data. It is more of a website and search technology project than a reusable library. Because it relates to torrent and magnet search, users should approach it with attention to copyright, legality, and responsible use.

OpenWebSpider is an Open Source multi-threaded Web Spider (robot, crawler) and search engine with a lot of interesting features!

Font-spider is a compress tool for WebFont which can analyze your web-page intelligently to find the fonts out which have been used and then compress them. Font subsetter, our tool is based on HTML and CSS analysis and completely running in local so that. Font converter supports woff2, woff, eot, svg font format generation.

NZBGetter is a PHP Script for linux based systems to spider NZB index sites for NZB files matching your predefined search patterns. The script downloads matching NZB files and passes them to your Usenet Reader.

It's multi protocol web chat with using modern web technologies such as ajax,css2(3). It also supports connect to IRC(based on SmartIRC) and Jabber Conference and may be will supports some other networks

Sperowider Website Archiving Suite is a set of Java applications, the primary purpose of which is to spider dynamic websites, and to create static distributable archives with a full text search index usable by an associated Java applet.

Spider is web crawler written in the Java.Based on an Regular expression string the spider parses the internet for web pages matching this string and stores it in an MYSQL database.