Showing 647 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Simple, Secure Domain Registration Icon
    Simple, Secure Domain Registration

    Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

    Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.
    Sign up for free
  • 1
    Wapiti

    Wapiti

    Wapiti is a web-application vulnerability scanner

    Wapiti is a vulnerability scanner for web applications. It currently search vulnerabilities like XSS, SQL and XPath injections, file inclusions, command execution, XXE injections, CRLF injections, Server Side Request Forgery, Open Redirects... It use the Python 3 programming language.
    Leader badge
    Downloads: 35 This Week
    Last Update:
    See Project
  • 2
    script-server

    script-server

    Web UI for your scripts with execution management

    Script-server is a Web UI for scripts. As an administrator, you add your existing scripts into Script server and other users would be able to execute them via a web interface. The UI is very straightforward and can be used by non-tech people. No script modifications are needed - you configure each script in Script server and it creates the corresponding UI with parameters and takes care of validation, execution, etc.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3

    Taylorplot_Neptune

    Creation of a Taylorplot for several machine learning models

    Here we present the lines of code for creating a taylor plot with python to display several machine learning models. We show the solution for displaying 10 models, but the list and number can be changed simply by modifying the sample list.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4

    TimerMiddleware

    Timing & instrumentation for python web apps

    Docs: https://pythonhosted.org/TimerMiddleware/ PYPI: https://pypi.python.org/pypi/TimerMiddleware
    Downloads: 0 This Week
    Last Update:
    See Project
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    The database for AI-powered applications.

    MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
    Start Free
  • 5
    EulerSharp

    EulerSharp

    Euler Yet another proof Engine

    EYE [1] is a reasoning engine supporting the Semantic Web layers [2]. It performs controlled chaining and it supports Euler paths [3]. Via N3 [4] it is interoperable with Cwm [5]. [1] http://eulersharp.sourceforge.net/README [2] http://www.w3.org/DesignIssues/diagrams/sweb-stack/2006a [3] http://mathworld.wolfram.com/KoenigsbergBridgeProblem.html [4] http://www.w3.org/TeamSubmission/n3/ [5] http://www.w3.org/2000/10/swap/doc/cwm
    Downloads: 1 This Week
    Last Update:
    See Project
  • 6

    Apache Allura

    Forge software for hosting software projects

    Apache Allura's website and resources are all at https://allura.apache.org/ Allura was originally developed here, which is why this project exists.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7

    cfe

    Framework for producing web-based database applications

    Sophisticated environment for developing web-based applications. It includes lots of handy low-level components including: 1/ mySql interface, including table creation, tables as class, query as iterator 2/ html generation 3/ multi-lingual ability 4/ html form field handling 5/ etc. On top of this is a high-level framework that allows rapid development of database apps including seach/create/display/update, user navigation between related entities and much more. Included, as a...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    OpenCarenet CHE

    OpenCarenet CHE

    Enabling community health workers to collect health data efficiently

    OpenCarenet CHE is a robust and user-friendly application tailored for community health workers, facilitating seamless data collection, management, and reporting. With its mobile data collection capabilities, offline functionality, and interoperability with DHIS2, the app empowers health professionals to efficiently track patient information, aggregate primary data, and generate detailed health reports, even in areas with limited internet access. Its multilingual support and configurable...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    lixa

    lixa

    LIXA, LIbre XA, is a free and open source XA transaction manager

    ...LIXA is a Transaction Manager but it's not a Transaction Monitor: this is the distinguishing feature of the project. LIXA technology enables every application container, like a web server or a shell, to become a two phase commit application server. The client/server architecture of LIXA allows many application containers to share a single LIXA (state) server: this is ideal when horizontal scalability is a must and many identical application containers must refer to a single transactional environment. LIXA can be used with the C, C++, Java, Python and COBOL programming languages.
    Downloads: 1 This Week
    Last Update:
    See Project
  • Build Securely on AWS with Proven Frameworks Icon
    Build Securely on AWS with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 10
    eCxx

    eCxx

    A C++ library for AVR and NodeMCU

    NOTE: This project is marked with 'Status: Abandoned' on SourceForge because not enough time can be dedicated to this project. However it may still get sporadic commits to the repository. eCxx is a library for AVR and NodeMCU tailored for micro LED displays and lighting effects. eCxx is utilizing Makefile build system. Java and Python based applications/tools are also included to ease the development and debugging process using the host PC. On one side, eCxx supports the original...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Shynet

    Shynet

    Modern, privacy-friendly, and detailed web analytics

    Modern, privacy-friendly, and detailed web analytics that works without cookies or JS. There are a lot of web analytics tools. Unfortunately, most of them come with the following caveats. They require handing all of your visitors' info to a third-party company They use cookies to track visitors across sessions, so you need to have those annoying cookie notices. They collect so much personal data that even the NSA is jealous. They are closed source and/or expensive, often with limited data...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    dorker-py

    Descubre archivos, rutas escondidas realizando busquedas avanzadas

    Dorking Google - Dorker Py Descubre archivos, rutas escondidas realizando busquedas avanzadas (ES) Discover files, hidden paths by performing advanced searches (EN)
    Downloads: 3 This Week
    Last Update:
    See Project
  • 13
    YouTube video web scraper 2 [ISA]

    YouTube video web scraper 2 [ISA]

    YouTube video web scraper 2 [Improved.Simplified.Alternative]

    'YouTube video web scraper 2' is an desktop application developed using python 3.11.4 and other add-on libaries. Finds YouTube video based on user request and view as table. Export the table as excel. Compatible only for windows OS.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Headscale-WebUI

    Headscale-WebUI

    A simple Headscale web UI for small-scale deployments

    A simple Headscale web UI for small-scale deployments.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    AI-Agent-Host

    AI-Agent-Host

    The AI Agent Host is a module-based development environment.

    The AI Agent Host integrates several advanced technologies and offers a unique combination of features for the development of language model-driven applications. The AI Agent Host is a module-based environment designed to facilitate rapid experimentation and testing. It includes a docker-compose configuration with QuestDB, Grafana, Code-Server and Nginx. The AI Agent Host provides a seamless interface for managing and querying data, visualizing results, and coding in real-time. The AI...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Web Widget

    Web Widget

    Basic Floating translucent WebBrowser Widget App for Windows.

    # Web-Widget 1.6 Basic Floating translucent Widget WebBrowser App for Desktop Unfortunately codecs to support video were not included due to copyright restrictions.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Portainer Templates

    Portainer Templates

    500+ 1-click Portainer app templates

    A compiled list of 500+ ready-to-go Portainer App templates. In Portainer, App Templates enable you to easily deploy services with a predetermined configuration, while allowing you to customize options through the web UI. While Portainer ships with some default templates, it's often helpful to have 1-click access to many more apps + stacks, without having to constantly switch template sources. This repo combines app templates from several sources, to create a ready-to-go template file...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18

    Render 4 Monitoring

    Render Web Services for Viewing/Monitoring and Test Web Applications

    Renders and aggregates other web services into static HTML monitoring output. Also implements simple and dynamic testing of web based applications using mechanize. Includes Basic authentication, and ADFS authentication for web service testing. Custom authentications can be implemented very easily with python programming. Implements PhantomJS rendering for Javascript/HTML5 dynamic web pages.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    ProxyPool

    ProxyPool

    An Efficient ProxyPool with Getter, Tester and Server

    Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using it....
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Cinemagoer

    Cinemagoer

    Python package to retrieve and manage data of the IMDb

    Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.
    Downloads: 15 This Week
    Last Update:
    See Project
  • 21
    Splinter

    Splinter

    Splinter - Python test framework for web applications

    Splinter is a Python test framework for web applications, providing a simple and consistent API for browser automation and testing.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 22
    Komodo Edit

    Komodo Edit

    Komodo Edit is a fast and free multi-language code editor

    Code faster with the IDE for today’s web languages – Python, PHP, Perl, Golang, Ruby, and more. Powerful editor with syntax highlighting, autocomplete, code refactoring, and more. Visual debugger and more to debug, inspect, and test your code. Support for Git, Mercurial, Subversion, CVS, Perforce and Bazaar. Tons of add-ons for customizing and extending features. Great tools for pair programming and collaboration.
    Downloads: 51 This Week
    Last Update:
    See Project
  • 23

    Kanbanara

    Web-based Project Management System using the Kanban methodology

    Kanbanara, a web-based Project Management System, uses the Kanban methodology. Started in 2013, the product is already quite well advanced. It is written in Python 3.7+ and utilizes MongoDB and CherryPy. Its Kanban board features projects, user-definable workflow with custom states, support for epic, feature, story, enhancement, defect, task, test, bug and transient cards, global and personal WIP limits, role-based columns (Owner, Reviewer or Quality Assurance), support for ghost cards (cards on their way to you or your own cards currently being reviewed or in QA), blockable cards, hidable cards, deferable cards, 46 card styles including a customisable one, 14-day future projection, Gantt Chart andcard backdrops. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    OpsManage

    OpsManage

    Automated operation and maintenance platform

    ...If you need to quote the project code in your own project, please declare the agreement and copyright information in the project. Programming language, Python3.6 + HTML + JScripts. Front-end web framework, Bootstrap. Backend Web Framework, Django. Backend Task Framework, Celery + Redis. Programming language is Python 3.6. Operating System is CentOS 6+. Ansible version 2.6+. Deployment platform and node server Rsync 3+.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    HASS Configurator

    HASS Configurator

    Configuration UI for Home Assistant

    ...The configurator fetches JavaScript libraries, CSS and fonts from CDNs. Hence it does NOT work when your client device is offline. And it is only available for Python 3.
    Downloads: 0 This Week
    Last Update:
    See Project