Showing 526 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    Build gen AI apps with an all-in-one modern database: MongoDB Atlas

    MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.
    Start Free
  • 1
    Headscale-WebUI

    Headscale-WebUI

    A simple Headscale web UI for small-scale deployments

    A simple Headscale web UI for small-scale deployments.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Wapiti

    Wapiti

    Wapiti is a web-application vulnerability scanner

    Wapiti is a vulnerability scanner for web applications. It currently search vulnerabilities like XSS, SQL and XPath injections, file inclusions, command execution, XXE injections, CRLF injections, Server Side Request Forgery, Open Redirects... It use the Python 3 programming language.
    Leader badge
    Downloads: 33 This Week
    Last Update:
    See Project
  • 3

    Roundup Issue Tracker

    Simple-to-use/-install issue-tracking system: web, REST, email, CLI

    Roundup is a simple-to-use and -install issue-tracking system with command-line, web, REST, XML-RPC, and e-mail interfaces. It runs on python 2.7 or 3.6 or newer. Roundup has been deployed for: * bug tracking and TODO list management (the classic installation) * customer help desk support (with a wizard for the phone answerers, linking to networking, system and development issue trackers) * issue management for IETF working groups * sales lead tracking ...and so on. It's been...
    Downloads: 18 This Week
    Last Update:
    See Project
  • 4
    Portainer Templates

    Portainer Templates

    500+ 1-click Portainer app templates

    A compiled list of 500+ ready-to-go Portainer App templates. In Portainer, App Templates enable you to easily deploy services with a predetermined configuration, while allowing you to customize options through the web UI. While Portainer ships with some default templates, it's often helpful to have 1-click access to many more apps + stacks, without having to constantly switch template sources. This repo combines app templates from several sources, to create a ready-to-go template file...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Simple, Secure Domain Registration Icon
    Simple, Secure Domain Registration

    Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

    Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.
    Sign up for free
  • 5
    wxMEdit

    wxMEdit

    wxMEdit, Cross-platform Text/Hex Editor, Improved Version of MadEdit

    •Added automatically checking for updates •Added bookmark support •Added right-click context menu for each tab •Added purging histories support •Added selecting a line by triple click •Added FreeBASIC syntax file •Added an option to place configuration files into %APPDATA% directory under Windows •Improved support for Find/Replace •Improved Mac OS X support •Improved system integration under Windows •Improved encoding detection result •Improved Hex editing support •Added more...
    Leader badge
    Downloads: 164 This Week
    Last Update:
    See Project
  • 6
    Goutte

    Goutte

    Goutte, a simple PHP Web Scraper

    Goutte is a screen scraping and web crawling library for PHP. Goutte provides a nice API to crawl websites and extract data from the HTML/XML responses. Goutte depends on PHP 7.1+. Add fabpot/goutte as a require dependency in your composer.json file. Create a Goutte Client instance (which extends Symfony\Component\BrowserKit\HttpBrowser). Make requests with the request() method. The method returns a Crawler object (Symfony\Component\DomCrawler\Crawler). To use your own HTTP settings, you may...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 7
    LAMP package in Complete Virtual Machine

    LAMP package in Complete Virtual Machine

    A Quick LAMP/WAMP/MAMP/XAMPP Pkg for development, testing & production

    This VM is created for 2 reasons: 1. Very little initial setup work required to Develop / Test / Deploy a Dynamic Web Application live, within minutes. 2. This system should keep running for Years, without requiring Updates / Breakages. If you are new to Virtual Machines, then please watch the Video below ( taken from my other sample PHP project called teamdocs. You may cleanup this Application from the htdocs home folder link & its corresponding database, after logging into mysql. The mysql...
    Downloads: 12 This Week
    Last Update:
    See Project
  • 8
    Basic Website Studio (Tkinter Edition)

    Basic Website Studio (Tkinter Edition)

    Basic Website Studio (Tkinter Edition)

    A simple, lightweight code editor for basic web development, written in Python using the standard Tkinter GUI toolkit. This application is designed to run without any external Python libraries (like PySide6 or PyQt), making it ideal for easy distribution on Linux systems, such as in a .deb package.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 9
    WhakerKit

    WhakerKit

    A seamless toolkit to manage dynamic websites and shared documents

    WhakerKit is a versatile toolkit for building websites with both static and dynamic HTML pages, developed by Brigitte Bigi, CNRS. WhakerKit offers seamless management of public and authenticated access, and simplifies document sharing for collaborative environments. It is based on the following technologies: * python >= 3.9 * (optional) PyJWT and ldap3 for authentication (install with pip) * WhakerPy >= 1.3: <https://whakerpy.sourceforge.io> (install with pip) * Whakerexa >= 0.7...
    Downloads: 1 This Week
    Last Update:
    See Project
  • Get the most trusted enterprise browser Icon
    Get the most trusted enterprise browser

    Advanced built-in security helps IT prevent breaches before they happen

    Defend against security incidents with Chrome Enterprise. Create customizable controls, manage extensions and set proactive alerts to keep your data and employees protected without slowing down productivity.
    Download Chrome
  • 10
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11

    TimerMiddleware

    Timing & instrumentation for python web apps

    Docs: https://pythonhosted.org/TimerMiddleware/ PYPI: https://pypi.python.org/pypi/TimerMiddleware
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    Taylorplot_Neptune

    Creation of a Taylorplot for several machine learning models

    Here we present the lines of code for creating a taylor plot with python to display several machine learning models. We show the solution for displaying 10 models, but the list and number can be changed simply by modifying the sample list.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13

    Apache Allura

    Forge software for hosting software projects

    Apache Allura's website and resources are all at https://allura.apache.org/ Allura was originally developed here, which is why this project exists.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    OpenCarenet CHE

    OpenCarenet CHE

    Enabling community health workers to collect health data efficiently

    OpenCarenet CHE is a robust and user-friendly application tailored for community health workers, facilitating seamless data collection, management, and reporting. With its mobile data collection capabilities, offline functionality, and interoperability with DHIS2, the app empowers health professionals to efficiently track patient information, aggregate primary data, and generate detailed health reports, even in areas with limited internet access. Its multilingual support and configurable...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    LAPP package in Complete Virtual Machine

    LAPP package in Complete Virtual Machine

    Quick Apache/PHP/Postgresql Pkg for development, testing & production

    This VM is created for 2 reasons: 1. Very little initial setup work required to Develop / Test / Deploy a Dynamic Web Application live. 2. This system should keep running for Years, without requiring Updates / Breakages. If you are new to Virtual Machines, then please watch the Video below ( taken from my other PHP project called teamdocs. Just replace td with lapp wherever mentioned ) Upload your PHP Files using the free FileZilla ftp client software, to this server called lapp.local...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    ProxyPool

    ProxyPool

    An Efficient ProxyPool with Getter, Tester and Server

    Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using it....
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Splinter

    Splinter

    Splinter - Python test framework for web applications

    Splinter is a Python test framework for web applications, providing a simple and consistent API for browser automation and testing.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 18
    Komodo Edit

    Komodo Edit

    Komodo Edit is a fast and free multi-language code editor

    Code faster with the IDE for today’s web languages – Python, PHP, Perl, Golang, Ruby, and more. Powerful editor with syntax highlighting, autocomplete, code refactoring, and more. Visual debugger and more to debug, inspect, and test your code. Support for Git, Mercurial, Subversion, CVS, Perforce and Bazaar. Tons of add-ons for customizing and extending features. Great tools for pair programming and collaboration. Python, PHP, Perl, Go, Ruby, Node.js, JavaScript, and more. Define your own...
    Downloads: 51 This Week
    Last Update:
    See Project
  • 19

    dorker-py

    Descubre archivos, rutas escondidas realizando busquedas avanzadas

    Dorking Google - Dorker Py Descubre archivos, rutas escondidas realizando busquedas avanzadas (ES) Discover files, hidden paths by performing advanced searches (EN)
    Downloads: 3 This Week
    Last Update:
    See Project
  • 20
    Hydrogen

    Hydrogen

    Run code interactively, inspect data, and plot

    Hydrogen is an interactive coding environment that supports Python, R, JavaScript and other Jupyter kernels. Hydrogen was inspired by Bret Victor's ideas about the power of instantaneous feedback and the design of Light Table. Running code inline and in real-time is a more natural way to develop. By bringing the interactive style of Light Table to the rock-solid usability of Atom, Hydrogen makes it easy to write code the way you want to. You also may be interested in our latest project...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    AI-Agent-Host

    AI-Agent-Host

    The AI Agent Host is a module-based development environment.

    The AI Agent Host integrates several advanced technologies and offers a unique combination of features for the development of language model-driven applications. The AI Agent Host is a module-based environment designed to facilitate rapid experimentation and testing. It includes a docker-compose configuration with QuestDB, Grafana, Code-Server and Nginx. The AI Agent Host provides a seamless interface for managing and querying data, visualizing results, and coding in real-time. The AI...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    LXR Cross Referencer
    A general purpose source code indexer and cross-referencer that provides web-based browsing of source code with links to the definition and usage of any identifier. Supports multiple languages. Up-to-date information in http://lxr.sourceforge.net
    Downloads: 4 This Week
    Last Update:
    See Project
  • 23
    OpsManage

    OpsManage

    Automated operation and maintenance platform

    ..., Python3.6 + HTML + JScripts. Front-end web framework, Bootstrap. Backend Web Framework, Django. Backend Task Framework, Celery + Redis. Programming language is Python 3.6. Operating System is CentOS 6+. Ansible version 2.6+. Deployment platform and node server Rsync 3+.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    HASS Configurator

    HASS Configurator

    Configuration UI for Home Assistant

    The HASS Configurator is a small web app (you access it via a web browser) that provides a filesystem browser and text-editor to modify files on the machine the configurator is running on. It has been created to allow easy configuration of Home Assistant. It is powered by Ace editor, which supports syntax highlighting for various code/markup languages. YAML files (the default language for Home Assistant configuration files) will be automatically checked for syntax errors while editing...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Cinemagoer

    Cinemagoer

    Python package to retrieve and manage data of the IMDb

    Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.
    Downloads: 12 This Week
    Last Update:
    See Project