Showing 739 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Deliver secure remote access with OpenVPN. Icon
    Deliver secure remote access with OpenVPN.

    Trusted by nearly 20,000 customers worldwide, and all major cloud providers.

    OpenVPN's products provide scalable, secure remote access — giving complete freedom to your employees to work outside the office while securely accessing SaaS, the internet, and company resources.
    Get started — no credit card required.
  • 1
    ReconSpider

    ReconSpider

    Most Advanced Open Source Intelligence (OSINT) Framework

    ... the capabilities of Wave, Photon and Recon Dog to do a comprehensive enumeration of attack surfaces. Reconnaissance is a mission to obtain information by various detection methods, about the activities and resources of an enemy or potential enemy, or geographic characteristics of a particular area. A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering).
    Downloads: 4 This Week
    Last Update:
    See Project
  • 2
    FlaskBB

    FlaskBB

    A classic Forum Software in Python using Flask

    ... can customize every template in FlaskBB. Besides that, you can also install community-made themes. Our goal is to develop a forum system with modern technologies and sticking to already well-tested and approved layouts. FlaskBB is a simple and extensible forum software that should be seen as the foundation for building communities. It is written in Python using the web framework Flask. FlaskBB is being distributed under the BSD 3-Clause License.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Reminiscence

    Reminiscence

    Self-Hosted Bookmark And Archive Manager

    Bookmark links and edit its metadata (like title, tags, summary) via web interface. Archive links to content in HTML, PDF or full-page PNG format. Automatic archival of links to non-html content like pdf, jpg, txt etc. i.e. Bookmarking links to pdf, jpg etc.. via the web interface will automatically save those files on the server. Supports archival of media elements of a web page using third-party download managers. Directory-based categorization of bookmarks. Automatic tagging of HTML links...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 4
    Paperless-ng

    Paperless-ng

    A supercharged version of paperless, scan, index and archive docs

    Paperless is a simple Django application running in two parts, a Consumer (the thing that does the indexing) and a Web server (the part that lets you search & download already-indexed documents). Paper is a nightmare. Environmental issues aside, there’s no excuse for it in the 21st century. It takes up space, collects dust, doesn’t support any form of a search feature, indexing is tedious, it’s heavy and prone to damage & loss. I wrote this to make “going paperless” easier. I do not have...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build Securely on Azure with Proven Frameworks Icon
    Build Securely on Azure with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 5
    DracOS GNU/Linux Remastered
    What is DracOS GNU/Linux Remastered ? DracOS GNU/Linux Remastered ( https://github.com/dracos-linux ) is the Linux operating system from Indonesia , open source is built based on Debian live project under the protection of the GNU General Public License v3.0. This operating system is one variant of Linux distributions, which is used to perform security testing (penetration testing). Dracos linux in Arm by hundreds hydraulic pentest, forensics and reverse engineering. Use a GUI-based...
    Downloads: 27 This Week
    Last Update:
    See Project
  • 6
    restless

    restless

    A lightweight REST miniframework for Python

    A lightweight REST mini framework for Python. Works great with Django, Flask, Pyramid & Tornado, but should be useful for many other Python web frameworks. Based on the lessons learned from Tastypie & other REST libraries. Restless tries to be RESTful by default, but flexible enough. The main Resource class has data methods (that you implement) for all the main RESTful actions. It also uses HTTP status codes as correctly as possible. Restless is BYOD (bring your own data) and hence, works...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    CEF Python

    CEF Python

    Python bindings for the Chromium Embedded Framework (CEF)

    ... use cases for CEF. Use it as a modern HTML5 based rendering engine that can act as a replacement for classic desktop GUI frameworks. Think of it as Electron for Python. Embed a web browser widget in a classic Qt / GTK / wxPython desktop application. Use it for automated testing of web applications with more advanced capabilities than Selenium web browser automation due to CEF low level programming APIs.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 8
    ML workspace

    ML workspace

    All-in-one web-based IDE specialized for machine learning

    All-in-one web-based development environment for machine learning. The ML workspace is an all-in-one web-based IDE specialized for machine learning and data science. It is simple to deploy and gets you started within minutes to productively built ML solutions on your own machines. This workspace is the ultimate tool for developers preloaded with a variety of popular data science libraries (e.g., Tensorflow, PyTorch, Keras, Sklearn) and dev tools (e.g., Jupyter, VS Code, Tensorboard) perfectly...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    OMLX project is a place for processing of many projects to be ready to become open source projects.
    Leader badge
    Downloads: 122 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 10
    Opyrator

    Opyrator

    Turns your machine learning code into microservices with web API

    Instantly turn your Python functions into production-ready microservices. Deploy and access your services via HTTP API or interactive UI. Seamlessly export your services into portable, shareable, and executable files or Docker images. Opyrator builds on open standards - OpenAPI, JSON Schema, and Python type hints - and is powered by FastAPI, Streamlit, and Pydantic. It cuts out all the pain for productizing and sharing your Python code - or anything you can wrap into a single Python function...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11
    wfCodeEditor

    wfCodeEditor

    A simple portable Code Editor for any language

    A simple portable Code Editor for any language. Signed application. View a preview of features here - https://wyntonfranklin.github.io/wfcodeeditor/ Embeded snippets for various languages Add your snippets Add your task wfTutorials right at your fingertips Feature a dark mode Portable Simple Command line interface Works with various languages (PHP, JAVA, Javascript, Python)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    TransPose

    TransPose

    PyTorch Implementation for "TransPose, Keypoint localization

    TransPose is a human pose estimation model based on a CNN feature extractor, a Transformer Encoder, and a prediction head. Given an image, the attention layers built in Transformer can efficiently capture long-range spatial relationships between keypoints and explain what dependencies the predicted keypoints locations highly rely on.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    kamiFaka

    kamiFaka

    kamiFaka

    Applicable to all kinds of e-commerce, coupons, forum invitation codes, recharge cards, activation codes, registration codes, Tencent iQiyi points CDK, etc., support manual and automatic delivery, and a tiered wholesale model similar to 1688. Stisla UI: The web interface is beautiful Front-end uses VUE3.0, millisecond-level response. Has integrated Alipay face-to-face payment, WeChat official, Payjs, Hupijiao, YunGouOS, Yipay, Mugglepay, V visa-free and other more than a dozen payment...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    speedtest-cli

    speedtest-cli

    Command line interface for testing internet bandwidth using speedtest

    ... connection performance metrics like download, upload, latency and packet loss natively without relying on a web browser. Test the internet connection of your Linux desktop, a remote server or even lower-powered devices such as the Raspberry Pi with the Speedtest Server Network. Set up automated scripts to collect connection performance data, including trends over time.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Linkchecker for Markdown

    Linkchecker for Markdown

    Python asyncio + aiohttp Markdown *.md URL link checker

    Blazing-fast (10000 Markdown files per second) Python asyncio / aiohttp based simple check of links in Markdown .md files only. This tool is very helpful for large Markdown-based Jekyll and Hugo sites as well as Markdown-based MkDocs documentation projects. It is very fast and simple.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Responder

    Responder

    A familiar HTTP Service Framework for Python

    Responder is a web service framework, written for human beings. This gets you a ASGI app, with a production static files server (WhiteNoise) pre-installed, jinja2 templating (without additional imports), and a production web server based on uvloop, serving up requests with gzip compression automatically. A pleasant API, with a single import statement. Class-based views without inheritance. ASGI framework, the future of Python web services. WebSocket support! The ability to mount any ASGI / WSGI...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 17
    workshops_project

    workshops_project

    Workshops is an open source, simple, dead-lightweight LMS

    Workshops is an open source, simple, dead-lightweight LMS (Learning Management System) application programmed in Python (version 3.8.x) with Django (version 2.2.x) web framework which main purpose is to make a standarized way to share knowledge via courses in a slide-based view in browser powered by remark javascript library, easy to create, edit, delete and show your courses using simple markdown and html if necessary. Inspired on an old project in my social labours to help share knowledge...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    ZED OS

    ZED OS

    ZED OS the clone of Windows XP

    ZED OS is a portuguese Linux based distribution (remaster of Ubuntu Mate). It was designed for users who want an innovative system. With both 3D and 2D interfaces you'll be able to chosse the better one according to your hardware/needs. It's Web Based and inspired in Windows XP from Microsoft
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Flask-MongoEngine

    Flask-MongoEngine

    MongoEngine flask extension with WTF model forms support

    Flask-MongoEngine is a Flask extension that provides integration with MongoEngine, WtfForms and FlaskDebugToolbar. By default, Flask-MongoEngine will install integration only between Flask and MongoEngine. Integration with WTFForms and FlaskDebugToolbar are optional and should be selected as extra option, if required. This is done by users request, to limit amount of external dependencies in different production setup environments. All methods end extras described below are compatible...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Hack-Tools

    Hack-Tools

    Hack tools

    hack-tools is a collection of various hacking tools and utilities. It serves as a comprehensive toolkit for penetration testers and cybersecurity enthusiasts, encompassing a wide range of functionalities.​
    Downloads: 4 This Week
    Last Update:
    See Project
  • 21
    Zebrunner Community Edition

    Zebrunner Community Edition

    Test Automation Management Tool

    Zebrunner CE (Community Edition) is a Test Automation Management Tool for continuous testing and continuous deployment. It allows you to run various kinds of tests and gain successive levels of confidence in the code quality. Zebrunner CE is integrated by default with Carina open-source TestNG framework and uses Jenkins as a CI Tool. It is built on top of popular docker solutions and includes Postgres database, Zebrunner Reporting, Jenkins Master/Slaves Nodes, Selenium Hub, Mobile...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    sierra

    sierra

    Python web framework for easy building and integrating with web apps

    Sierra is a lightweight Python framework for building and Integrating Web Applications with HTML and CSS using simple enough syntax. You can develop your web applications purely with Python, taking advantage of its functionalities and integrating them to the fullest. Sierra is easy to start off with, and combining Python with HTML and CSS could never have been easier with both dynamic and static pages. When it comes to static pages, you wouldn't even need a server to run, say, a Python...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Not Pure Poole

    Not Pure Poole

    A simple, beautiful, and powerful Jekyll theme for blogs

    Not Pure Poole is a simple, beautiful, and powerful Jekyll theme for blogs. It is built on Poole and Pure.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Kore

    Kore

    Scalable and secure web application framework

    Kore is a web application platform for writing scalable, concurrent web-based processes in C or Python. It is built with a "secure by default" approach. It is fully privileged separated while using strong security features at the operating system level such as second, pledge, unveil, and more. Today Kore is used in a variety of applications ranging from high assurance cryptographic military devices, machine-learning stacks and even in the aerospace industry. From embedded platforms all the way...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    Notoma

    Notoma

    Use Notion as your blogging editor, with any static gen blog engine

    Use Notion as your blogging editor, with any static gen blog engine. Notoma converts Notion pages to Markdown files. Convert contents of your Notion Blog database to a bunch of Markdown files. Watch Notion Blog database for updates and regenerate Markdown files on any updates. Create a new Notion database for your Blog with all required fields.
    Downloads: 0 This Week
    Last Update:
    See Project
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.