Showing 495 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Build Securely on AWS with Proven Frameworks Icon
    Build Securely on AWS with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 1
    Raven Python

    Raven Python

    Raven is the legacy Python client for Sentry

    Raven is the official legacy Python client for Sentry, officially supports Python 2.6–2.7 & 3.3–3.7, and runs on PyPy and Google App Engine. It tracks errors and exceptions that happen during the execution of your application and provides instant notification with detailed information needed to prioritize, identify, reproduce, and fix each issue. It provides full out-of-the-box support for many of the popular Python frameworks, including Django, and Flask. Raven also includes drop-in support...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Xplico

    Xplico

    Xplico is a Network Forensic Analysis Tool (NFAT)

    Xplico is a Network Forensic Analysis Tool (NFAT). The goal of Xplico is extract from an internet traffic capture the applications data contained. For example, from a pcap file Xplico extracts each email (POP, IMAP, and SMTP protocols), all HTTP contents, each VoIP call (SIP, MGCP, MEGACO, RTP), IRC, WhatsApp... Xplico is able to classify more than 140 (application) protocols. Xplico cam be used as sniffer-decoder if used in "live mode" or in conjunction with netsniff-ng. Xplico is used...
    Downloads: 13 This Week
    Last Update:
    See Project
  • 3
    Mobile Cursor

    Mobile Cursor

    No need to install from your phone. It uses browser as a controller.

    Control your mouse cursor from your phone, and you only need your web browser! No additional app required.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    pyspider

    pyspider

    A powerful Spider(Web Crawler) system in Python

    pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone...
    Downloads: 1 This Week
    Last Update:
    See Project
  • Powering the best of the internet | Fastly Icon
    Powering the best of the internet | Fastly

    Fastly's edge cloud platform delivers faster, safer, and more scalable sites and apps to customers.

    Ensure your websites, applications and services can effortlessly handle the demands of your users with Fastly. Fastly’s portfolio is designed to be highly performant, personalized and secure while seamlessly scaling to support your growth.
    Try for free
  • 5
    myHouse

    myHouse

    Home monitoring and automation suite now known as eGeoffrey

    PLEASE NOTE: myHouse has been a nice starting point but difficult to customize, maintain and evolve. For these and many other reasons, I've completely re-designed- re-architect myHouse also giving it a new name (eGeoffrey). The basic principles are the same, the software is still open source but now is supposed to be way simpler to configure (entirely via the web interface), use, customize and extend. If you want to give it a look, check out https://www.egeoffrey.com. I've also put...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6

    Face Recognition

    World's simplest facial recognition api for Python & the command line

    Face Recognition is the world's simplest face recognition library. It allows you to recognize and manipulate faces from Python or from the command line using dlib's (a C++ toolkit containing machine learning algorithms and tools) state-of-the-art face recognition built with deep learning. Face Recognition is highly accurate and is able to do a number of things. It can find faces in pictures, manipulate facial features in pictures, identify faces in pictures, and do face recognition...
    Downloads: 12 This Week
    Last Update:
    See Project
  • 7
    OpenSearchServer Search Engine

    OpenSearchServer Search Engine

    An open source search engine with RESTFul API and crawlers

    OpenSearchServer is a powerful, enterprise-class, search engine program. Using the web user interface, the crawlers (web, file, database, etc.) and the client libraries (REST/API , Ruby, Rails, Node.js, PHP, Perl) you will be able to integrate quickly and easily advanced full-text search capabilities in your application: Full-text with basic semantic, join queries, boolean queries, facet and filter, document (PDF, Office, etc.) indexation, web scrapping,etc. OpenSearchServer runs on Windows...
    Downloads: 20 This Week
    Last Update:
    See Project
  • 8
    VSCP Protocol & Friends
    A project for a highly scalable protocol and framework and a collection of software tools for m2m (machine to machine communication) and IoT Internet of Things. The programs here works on Windows and Linux and are based around VSCP, The Very Simple Control Protocol. Repository is here: https://github.com/grodansparadis/vscp_software and here https://github.com/grodansparadis/vscp_firmware
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9

    PiHass

    Pre-defined and easy to use Home-Assistant Image for raspberry pi

    This is a Raspbain Strech base image with Home-Assistant on it. i used Virtual Env based installation and added some Custom Ui and Custom Components. i have also configured MySQL server and database and also some scripts, sensors and groups to help users start working with the system.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    The database for AI-powered applications.

    MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
    Start Free
  • 10
    Assorted projects. General-purpose libraries for Python, C++, Scala, bash, and others. Meta-programming tools. System utilities. UI components. Web APIs. Configuration files. Benchmarks. Programming competition entries. And much more.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    owfs and owhttpd

    owfs and owhttpd

    Project moved to https://github.com/owfs/owfs/

    Please note that OWFS source code, and all Issue/Tickets/merge requests have now been moved to https://github.com/owfs/owfs/. Developer mailing lists will still be kept at Sourceforge. ---- OWFS -- 1-Wire file system. Use the Dallas 1-Wire and iButton chips with standard filesystem commands. Create temperature loggers. Monitor everything. OWHTTPD -- same system, only used as a light weight web server. OWFS is also ported to embedded routers, Mac OSX and Windows. Basically you can use...
    Downloads: 9 This Week
    Last Update:
    See Project
  • 12

    Config Backup for F5

    Backup program for F5 Big IP devices

    This project is a Python program with PHP web UI to manage daily backups of F5 BigIP devices. It also is available as a turnkey VMware appliance requiring no Linux skills to use. Disclaimer - This project is an independent work under the GPL v2 license and is NOT provided by or supported by F5 Networks. It is provided as is with no warranty. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 13

    Apache GUI

    A free open sourced Apache Http Server GUI developed with Java.

    This project is used to provide a free java based open source Apache Http Server GUI. The solution is deployed as a web application that is accessible through a web browser. The solution is designed to be compatible with modern Windows and IX operating systems. Source code for this project is hosted on github https://github.com/jrossi227/ApacheGUI
    Downloads: 34 This Week
    Last Update:
    See Project
  • 14

    freenas-tempreport

    FreeNAS Temperature Report

    FreeNAS Temperature Report is a small server program that provides temperature readings for your FreeNAS unit. Install this program in a jail on your FreeNAS, then use your web browser and go to http://jail_ip to see your temperature readings. Installation instructions: http://sourceforge.net/p/freenas-tempreport/wiki/Install/
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    diskover

    diskover

    File system crawler and disk space usage software

    diskover is a file system crawler and disk space usage software that uses Elasticsearch to index your file metadata. diskover crawls and indexes your files on a local computer or remote storage server over network mounts. diskover helps manage your storage by identifying old and unused files and give better insights into data change "hotfiles", file duplication "dupes" and wasted space. It is designed to help deal with managing large amounts of data growth and provide detailed storage...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    DreamStudio by Volocian Studios
    Volocian believes first and foremost that financial status shouldn’t be a barrier to entry in multimedia content creation. Whether you want to design a product or website, record a band, remix a song, or produce a feature length movie with professional post production graphics and effects, Volocian™ wants to help, even if you’re using borrowed hardware with no previous experience. We provide affordable products and services for any budget, including cost-free solutions for education and demo...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 17
    Amon

    Amon

    Amon is a modern server monitoring platform

    Amon is a monitoring tool that provides real-time insights into server performance, application logs, and system metrics.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Antorca
    A performance and usability focused Linux distribution based on 64-bit Debian testing. It is the successor to illume OS. To use the live ISO image, login to "root" with the password "antorca".
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Jarvis Home Automation

    Jarvis Home Automation

    Home automation with wake word detection and SMS commands.

    Jarvis is a Home Assistant (https://home-assistant.io/) implementation with wake word detection, SMS commands, and a lot of automation control. While the Conversation component does it's job, it's currently a bit limited and without wake word detection it was almost useless to me. I also have tried the AlexaPi implementation as well as using Amazon Alexa products. However, creating custom intents was not as straight forward as I would have liked for quick and easy creation. Between wake word...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20

    PotHead

    PotHead

    ...! 5) Run the python file! Pothead.py -pp 22 23 -site http://YOURSITE.COM/api/write.php -apikey YOURAPIKEY 6) Profit! Is this for anyone? Hmmmm, yes and no I would suggest you know a thing or two about PHP & Python. It’s a pre-release and still in the early alpha stage. Is it safe? It’s pretty safe ;) Does it work? Yeah check it live! http://7ol.eu/view.php
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    LogicalLogViewer

    LogicalLogViewer

    Parses a log file, shows the relevant information in a table

    Parses a log (file or http), shows the relevant information in the form of a table. Allows filtering, searching, limited keyword highlighting. Is fully customizable: - which information to show - adding alternative parsers - reads from a file or a http server Current alpha version supports multiple parsers, for which the specification is found in an XML file (which should have the extension '.lpc'. The interface is not customizable yet. If you're interested in how it is done, check out the code.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    AlienVault OSSIM

    AlienVault OSSIM

    Open Source SIEM

    OSSIM, AlienVault’s Open Source Security Information and Event Management (SIEM) product, provides event collection, normalization and correlation. For more advanced functionality, AlienVault Unified Security Management (USM) builds on OSSIM with these additional capabilities: * Log management * Advanced threat detection with a continuously updated library of pre-built correlation rules * Actionable threat intelligence updates from AlienVault Labs Security Research Team * Rich...
    Leader badge
    Downloads: 75 This Week
    Last Update:
    See Project
  • 23
    mediaTUM is free software written in Python for archiving and retrieval of images, documents and other research data. It was originally developed in the framework of the DFG project IntegraTUM and is continuously expanded with new functionalities as required.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Open Automation

    Open Automation

    Building automation (like KNX or OpenHAB) software (like CometVisu).

    This project aims to provide software usefull in automation tasks like building automation. Different backends are supported like KNX or OpenHAB. Note: The project has moved to GitHub. Please consult: https://github.com/CometVisu/CometVisu - for the CometVisu https://github.com/OpenAutomationProject - for the different OpenAutomation subprojects
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    SIGAR (System Information Gatherer and Reporter) is a cross-platform, cross-language library and command-line tool for accessing operating system and hardware level information in Java, Perl and .NET.
    Leader badge
    Downloads: 35 This Week
    Last Update:
    See Project
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.