Showing 682 open source projects for "python web crawler"

View related business solutions
  • Veeam Data Platform v13.1 - Get Your Free Trial Icon
    Veeam Data Platform v13.1 - Get Your Free Trial

    Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

    Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
    Try it Free
  • Ship Agents Faster Icon
    Ship Agents Faster

    Transform your applications and workflows into powerful agentic systems at global scale.

    Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
    Start Free
  • 1
    django-rest-auth

    django-rest-auth

    This app makes it extremely easy to build Django powered SPA's

    This app makes it extremely easy to build Django powered SPA's (Single Page App) or Mobile apps exposing all registration and authentication-related functionality as CBV's (Class Base View) and REST (JSON). Tivix rebuilt a NATO software system to organize and coordinate rescue missions for submarines in distress across the globe. The United Nations Partner Portal (UNPP) is a web application built for a group of UN agencies to simplify their business processes and streamline collaboration...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    Trigger Happy

    Trigger Happy

    Automate the exchanges of the data between applications

    Automate the exchanges of the data between the applications and services you use on the web. Make Twitter talk to Mastodon, make Github talk to Mattermost, store your favorite tweets by creating notes in Evernote, follow RSS feeds and post each news in Wallabag, Pocket or Evernote. The possibilities are too numerous to name all of them, but with that project you won't have to raise your little finger at all: automate everything and make your life easier. And last but not least, as this is...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 3
    django-dynamic-scraper

    django-dynamic-scraper

    Creating Scrapy scrapers via the Django admin interface

    Django Dynamic Scraper (DDS) is an app for Django build on top of the scraping framework Scrapy. While preserving many of the features of Scrapy it lets you dynamically create and manage spiders via the Django admin interface. With Django Dynamic Scraper (DDS) you can define your Scrapy scrapers dynamically via the Django admin interface and save your scraped items in the database you defined for your Django project. Since it simplifies things DDS is not usable for all kinds of scrapers, but...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 4
    ATX

    ATX

    Smart phone automation tool. Support iOS, Android, WebApp and game

    ATX (AutomatorX) is an open source automated testing tool that supports testing native applications, games, and Web applications on iOS and Android platforms. Use Python to write test cases, and use image recognition and control positioning technology to complete the automation of the game. Attach a dedicated IDE to complete scripting quickly. The libraries for Android and iOS native application testing have been separated and can be used alone (it is strongly recommended to use it alone, firstly, it has less dependencies and high stability, and secondly, it can be automatically completed when writing code)
    Downloads: 4 This Week
    Last Update:
    See Project
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • 5
    Python Taint

    Python Taint

    Static Analysis Tool for Detecting Security Vulnerabilities in Python

    Static analysis of Python web applications based on theoretical foundations (Control flow graphs, fixed point, dataflow analysis) Detect command injection, SSRF, SQL injection, XSS, directory traveral etc. A lot of customization is possible. For functions from builtins or libraries, e.g. url_for or os.path.join, use the -m option to specify whether or not they return tainted values given tainted inputs, by default this file is used.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 6
    Bowtie

    Bowtie

    Create a dashboard with python!

    Bowtie is a library for writing dashboards in Python. No need to know web frameworks or JavaScript, focus on building functionality in Python. Interactively explore your data in new ways! Deploy and share with others! Bowtie uses Yarn to manage node packages. If you installed Bowtie through conda, Yarn was also installed as a dependency. Yarn can be installed through conda. An early integration with Jupyter has been prototyped.
    Downloads: 8 This Week
    Last Update:
    See Project
  • 7

    etalon

    Standards Document Redaction System

    The best process for creating standards is that of the IETF’s RFCs. Standard documents are written, submitted for publication, reviewed, and finally approved. Then they get a official number and hence can be referenced. Some can even be blessed to be an official standard. Etalon will implement this whole process, web-based and with markdown documents. Create your company’s standards the RFC way!
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Leo is an outlining-oriented project manager and browser. With Leo you can organize programs, web sites, URL's, pictures or any other kind of data. Leo is fully scriptable in Python. Leo is 100% pure Python. It requires the Qt gui toolkit.
    Leader badge
    Downloads: 16 This Week
    Last Update:
    See Project
  • 9

    Face Recognition

    World's simplest facial recognition api for Python & the command line

    Face Recognition is the world's simplest face recognition library. It allows you to recognize and manipulate faces from Python or from the command line using dlib's (a C++ toolkit containing machine learning algorithms and tools) state-of-the-art face recognition built with deep learning. Face Recognition is highly accurate and is able to do a number of things. It can find faces in pictures, manipulate facial features in pictures, identify faces in pictures, and do face recognition on a...
    Downloads: 8 This Week
    Last Update:
    See Project
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Start Free
  • 10
    Assorted projects. General-purpose libraries for Python, C++, Scala, bash, and others. Meta-programming tools. System utilities. UI components. Web APIs. Configuration files. Benchmarks. Programming competition entries. And much more.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11
    JavaScript Lint is a development tool that validates JavaScript code for best coding practices, finding common mistakes without actually running the script or opening the web page.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    coldev

    C/C++ , PHP, PYTHON, 3D ENGINES, CHROME NATIVE CLIENT

    + C/C++ and PHP projects, Python and Others + 3D ENGINES + Videogames Projects based in Bennugd http://www.bennugd.org Web Page https://coldev.sourceforge.io/
    Leader badge
    Downloads: 43 This Week
    Last Update:
    See Project
  • 13
    A Complete Beginner's Guide to Django

    A Complete Beginner's Guide to Django

    A Complete Beginner's Guide to Django - Code Samples

    ...A tutorial that would be easy to follow, informative and fun to read. That was when I came up with the idea to create some comics along the text to illustrate some concepts and scenarios. I hope you enjoy the reading! Django is a Web framework written in Python. A Web framework is a software that supports the development of dynamic Web sites, applications, and services. It provides a set of tools and functionalities that solves many common problems associated with Web development.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    DC/OS

    DC/OS

    DC/OS - The Datacenter Operating System

    DC/OS (Datacenter Operating System) is an open-source distributed operating system based on the Apache Mesos kernel. It abstracts a cluster of machines into a single logical computer, simplifying the deployment and management of containerized applications and services. DC/OS provides a comprehensive platform for running modern applications with features like container orchestration, service discovery, and scalability.​
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Pootle Django

    Pootle Django

    Online translation tool

    Pootle is written in Python using the Django framework and therefore can be installed on any web server that supports serving WSGI applications. Key localization file formats are supported, including Gettext PO, XLIFF, Java .properties, PHP arrays and many more supported by the Translate Toolkit. Ensures the best quality localizations by automatically detecting common errors made by translators.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 16
    Flasky

    Flasky

    Companion code to my O'Reilly book "Flask Web Development"

    Flasky is a comprehensive example web application built with the Flask microframework that demonstrates best practices for developing real-world Python web applications, covering everything from project structure and configuration to database models, authentication, and deployment. It serves as both a tutorial and sample codebase that walks developers through building a full-featured web application, including user registration and login, role-based permissions, user profiles, and content creation. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    PyXB (“pixbee”) is a pure Python package that generates Python source code for classes that correspond to data structures defined by XMLSchema. In concept it is similar to JAXB for Java and CodeSynthesis XSD for C++.
    Leader badge
    Downloads: 91 This Week
    Last Update:
    See Project
  • 18
    wxpy

    wxpy

    Probably the most elegant Wechat personal number API

    On the basis of itchat, wxpy improves the ease of use of the module through a large number of interface optimizations and provides rich function expansion. All in all, it can be used to automate the operation of various WeChat personal accounts. Judging from the recent feedback (late June 2017), there is a certain probability that the use of robots may be restricted from logging in. It is mainly manifested in the inability to log in to Web WeChat (but does not affect other platforms such as...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 19
    REST framework JWT Auth

    REST framework JWT Auth

    JSON Web Token Authentication support for Django REST Framework

    JSON Web Token Authentication support for Django REST Framework. This package provides JSON Web Token Authentication support for Django REST framework. Unlike some more typical uses of JWTs, this module only generates authentication tokens that will verify the user who is requesting one of your DRF protected API resources. The actual request parameters themselves are not included in the JWT claims which means they are not signed and may be tampered with. You should only expose your API...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Flask JSONDash

    Flask JSONDash

    Build complex dashboards without any front-end code

    Build complex dashboards without any front-end code. Use your own endpoints. JSON config only. Ready to go. Easily configurable, chart dashboards from any arbitrary API endpoint. JSON config only. Ready to go. This project is a flask blueprint that allows you to create sleek dashboards without writing any front-end (or backend) code. Everything is powered through simple JSON configurations for declaring arbitrary charts. Leveraging popular libraries like C3.js and D3.js, and much more. Also...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    TensorFlow World

    TensorFlow World

    Simple and ready-to-use tutorials for TensorFlow

    This repository aims to provide simple and ready-to-use tutorials for TensorFlow. The explanations are present in the wiki associated with this repository. There are different motivations for this open source project. TensorFlow (as we write this document) is one of / the best deep learning frameworks available. The question that should be asked is why has this repository been created when there are so many other tutorials about TensorFlow available on the web? Deep Learning is in very high...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    FoxNuke

    FoxNuke

    A Proffesional Stress-Testing(ddos) tool for pentesters

    The FoxNuke program is written in python and uses Firefox in order to complete the distributed denial of service attack feature. Multiple headers are used from the Firefox browser, along with a personal configuration option for the Opera browser. The FoxNuke Program is still underdevelopment as of 8/24/17, full release is set to come out sometime during 2017-2018. If you would like to participate in the TESTING of this program and would like to help report bugs, etc. then please email...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    NTK RTMP SERVER

    NTK RTMP SERVER

    Naam Tamilar Web TV Live Streamer

    Naam Tamilar RTMP Server This project updated as open source for future use of Naam Tamilar Political Party. To contribute to the party and in some case if there is any possibilities if i cannot support them for long term. I thought of sharing this source code so in future it may be helpful for the community and party in which other software developers can help them to upgrade. This source is forked from - https://github.com/arut/nginx-rtmp-module and modified with multiple broadcast...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 24
    C++ Standard Airline IT Object Library
    That project aims at providing a clean API, and the corresponding C++ implementation, for the basis of Airline IT Business Object Model (BOM), ie, to be used by several other Open Source projects, such as RMOL, Air-Sched, Travel-CCM, OpenTREP, etc.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 25
    Note: latest version can be found at https://github.com/targeted/pythomnic3k Pythomnic3k is a Python 3 framework for service-oriented middleware with hot reloading and fault tolerance. It is used for integrating various systems in enterprise network or writing standalone network services.
    Downloads: 0 This Week
    Last Update:
    See Project