pyspider Files

A powerful Spider(Web Crawler) system in Python

This is an exact mirror of the pyspider project, hosted at https://github.com/binux/pyspider. SourceForge is not affiliated with pyspider. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2016-08-18	876 Bytes	0
v0.3.8.tar.gz	2016-08-18	2.2 MB	0
v0.3.8.zip	2016-08-18	2.3 MB	0
Totals: 3 Items		4.5 MB	0

New features:

Now you can use cancel to stop an active task of a task with auto_recrawl enabled.
Handler.crawl_config will now be applied to the task when fetching. (It's applied when the task created before, that means proxy/headers can be changed afterward). See http://docs.pyspider.org/en/latest/apis/self.crawl/#handlercrawl_config

Fix several bugs:

* Fixed a global config object thread interference issue, which may cause connect to scheduler rpc error: error(10061, '') error when all --run-in=thread (default in windows platform)
Fix response.save lost when fetch failed issue
Fix potential scheduler failure caused by old version of six
Fix result dump return nothing when using mongodb backend

Source: README.md, updated 2016-08-18

Other Useful Business Software

Enterprise-grade ITSM, for every business Icon

Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.

Try it Free

Sales CRM and Pipeline Management Software | Pipedrive Icon

Sales CRM and Pipeline Management Software | Pipedrive

The easy and effective CRM for closing deals

Pipedrive’s simple interface empowers salespeople to streamline workflows and unite sales tasks in one workspace. Unlock instant sales insights with Pipedrive’s visual sales pipeline and fine-tune your strategy with robust reporting features and a personalized AI Sales Assistant.

Try it for free

Recommended Projects

body-parser
Node.js body parsing middleware
Clonezilla
A partition and disk imaging/cloning program
KeePass
A lightweight and easy-to-use password manager
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
Apache OpenOffice
The free and Open Source productivity suite