Showing 1049 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Grafana: The open and composable observability platform Icon
    Grafana: The open and composable observability platform

    Faster answers, predictable costs, and no lock-in built by the team helping to make observability accessible to anyone.

    Grafana is the open source analytics & monitoring solution for every database.
    Learn More
  • 1

    IAD dispatch web scraper

    A very simple web scraper for taxi dispatch data.

    Introduction: The Dulles International Airport (IAD) near Washington, D.C. has a taxi service provided by the Washington Flyer. Taxi cabs are leased by drivers and rides are regulated using a queue system. Drivers enter a corral near the Arrival gate and wait for dispatchers to announce passengers. There is a website that displays useful information about the queue. The number of taxis waiting in queue, the wait time of the last vehicle out, and the number of taxis to exit the corral in...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Simple yet powerful multi-threaded object-oriented CGI/FastCGI/WSGI/mod_python/html-templating modules for Python. This project has moved to GitHub: https://github.com/jribbens/jonpy
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    a Project with All the bells and whistles to allow the average user to fully benefit from HTTP,DNS,FTP,SSH through python, allowing quick and easy deploying of servers without compiling, or installing anything but our favorite language.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    SteppedStateMachine

    SteppedStateMachine

    Creates and operates a stepped state machine

    Implements a stepped state machine, i.e. a state machine which executes a single state transition at a time. Because of this, no data, e.g. state data, can be stored between executions. Instead, any such data must be stored in persistent storage between executions. This permits operation of the state machine as a CGI program in a web server. A WSGI or fastCGI or other such web server is not required. Received symbols may be received from sources outside the state machine, or may be...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build Securely on AWS with Proven Frameworks Icon
    Build Securely on AWS with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 5
    dotCODES_Source_Control_for_VS

    dotCODES_Source_Control_for_VS

    The dotCODES Source Control Maintenance Mainframe (SCM2)

    The dotCODES Source Control Maintenance Mainframe for Visual Studio is an administrator console application for developing dotCODES components. Built upon a Python foundation, the program is used to create data center routines (Unix packages) and maintain enterprise cloud services (CGI scripts/Apache) by means of building dotCODES runtimes and deploying them to and from the client server.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    MultiPlink

    MultiPlink

    [UPDATE 28-10-2015] FINAL MULTIPLINK SSH LIFETIME v2.0 UP-5 "FAREWELL"

    Download Link Utama: http://sourceforge.net/projects/multiplink/files/Final_MultiPlink_SSHLIFETIME_2.0_UP-5_FAREWELL.rar/download Jika di Halaman Download, Link belum tersedia, klik link alternatif : https://www.dropbox.com/s/znptxp2gxhihpax/Final_MultiPlink_SSHLIFETIME_2.0_UP-5_FAREWELL.rar?dl=0 Lalu Download & Install juga Minor...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Poor Http

    Poor Http

    WSGI Server, WSGI Connector, Python doc generator

    Poor Http Server is standalone wsgi server, which is designed for using python web applications. Unlike other projects, this is not framework, but single server, light wsgi connector, and python doc generator.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8

    WebCollector

    WebCollector is an open source web crawler framework based on Java.

    WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes. Github: https://github.com/CrawlScript/WebCollector Demo: https://github.com/CrawlScript/WebCollector/blob/master/YahooCrawler.java
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Flashlight

    Flashlight

    The missing Spotlight plugin system

    Search the web, save a note, add a reminder, or do over 200 other things, just by typing into your Mac's Spotlight search box. Or write your own plugins. Flashlight is an open platform for Spotlight, which allows developers to write plugins that extend OS X's built-in search with new features. Flashlight is an unofficial Spotlight API that allows you to programmatically process queries and add additional results. It's very rough right now, and a horrendous hack, but a fun proof of concept....
    Downloads: 0 This Week
    Last Update:
    See Project
  • Call center software with almost endless possibilities Icon
    Call center software with almost endless possibilities

    Squaretalk is an integration-friendly cloud communications platform for sales and support teams.

    Powerful and versatile communications platform with automations and integrations made simple. So simple, you’ll have time for the other parts of your business.
    Learn More
  • 10

    PyCancerDB

    Cancer Proteomics Database display and management

    PyCancerDB is a source code distribution providing a Web-based interface for browsing and updating the Cancer Proteomics Database, together with scripts for maintaining the database.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Java-based framework for decoupling back-end services and front-end interfaces. Browse and interact with a database, a class library, a network, a log file, or any live java object as though it were a filesystem. (It works with filesystems too!)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    PyLucid is a Open Source web content management system written in Python using the Django Framework. fully customizable output, expandable with plugins, i18n, L10n, Revision controled, support many database engines, WSGI conform and many more...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13

    python-web_excavator

    Genral Data Mining API: Only write html parsing code.

    A general web scraper that uses the requests library to communicate with the website. Scraper() contains a parser object, which you can add parsing handles to. ParseHandle() is the code mining for you data from an html source. Repo: https://github.com/crispycret/web_excavator
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    huhamhire-hosts

    huhamhire-hosts

    hosts for Internet Freedom

    Since the governments of some countries are using the blocking the internet access to several websites and web service providers which includes some world famous sites like Google, YouTube, twitter, Facebook, and Wikipedia etc., we designed this tiny utility in order to help people getting through the Internet blockade. Hosts Setup Utility provides basic tools to manage the hosts file on current operating systems. It also provides both support for Graphical Desktop environment with...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 15

    Roxy Fileman

    Web file manager

    Free file browser for CKEditor and TinyMCE. Can be used in any web application. Ready for use with ASP .NET and PHP - all scripts are included. User unterface completely separated from the server side logic. Language independant server side scipts - can be implemented in any programming language - PHP, ASP .NET, Python etc. Latest versions is available at http://www.roxyfileman.com/download
    Downloads: 1 This Week
    Last Update:
    See Project
  • 16

    Igorx

    Modular Web-/Application server framework

    Igorx is a modular Web-/Application server written in Python and C++.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Addons for IOSEC - DoS HTTP Security

    Addons for IOSEC - DoS HTTP Security

    IOSec Addons are enhancements for web security and crawler detection

    IOSEC PHP HTTP FLOOD PROTECTION ADDONS IOSEC is a php component that allows you to simply block unwanted access to your webpage. if a bad crawler uses to much of your servers resources iosec can block that. IOSec Enhanced...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    AMPPS

    AMPPS

    AMPPS is a LAMP/MAMP/WAMP stack

    AMPPS is a stack of Apache, MySQL, PHP, Perl & Python. AMPPS enables you to focus more on using applications rather than maintaining them. With AMPPS you can create a website by installing any of the 330+ Apps, customizing it, and then simply publishing it on the internet via a wide choice of hosting service providers. A complete package on your desktop, same like the server that provides many open source web applications.
    Downloads: 13 This Week
    Last Update:
    See Project
  • 19
    The Burster 3D
    Web browser plug-in for hosting real 3D on the websites.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    The goal of this project is to make possible to access Progress database from any external program that can use sockets. The server (broker and agents) are written in Progress 4GL and made use of sockets capabilities of Progress V9.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21

    CFPanel

    Web panel for keeping track of crowdfunding projects

    A web panel where to keep track of crowdfunding projects in which you have taken part.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Sight Reading Trainer

    Sight Reading Trainer

    Scrolling notes in any key for any instrument

    The MIDI Sight Reader Java Applet works again! To use it you should use Firefox with Java Applet Plug-in installed. Developed using Firefox 25.0.1 and Java 7, Update 51. So what is it? Well it scrolls random notes within a selected key, playing them aloud for audio confirmation, while you, the user, play the notes on your instrument. There is no MIDI interface, the name refers to MIDI because it uses the Java Midi API and organizes everything numerically, according to MIDI numbers. The...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23

    Penetration-Testing-Toolkit v1.0

    A web interface for various penetration testing tools

    Penetration-Testing-Toolkit is a web based project to automate Scanning a network,Exploring CMS, Generating Undectable metasploit payload, DNS-Queries, IP related informations, Information Gathering, Domain related info etc
    Downloads: 6 This Week
    Last Update:
    See Project
  • 24

    ReorJS

    Distributed Computing with JavaScript

    Create your own distributed computer that can distributed javascript based applications to any computer with a web browser, headless browser or node.js installation. For more information and updates please see our website - http://reorjs.com.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25

    gooseweb

    A lightweight, no bullshit web browser written in python

    Downloads: 0 This Week
    Last Update:
    See Project