Showing 526 open source projects for "python web crawler"

View related business solutions
  • Gen AI apps are built with MongoDB Atlas Icon
    Gen AI apps are built with MongoDB Atlas

    Build gen AI apps with an all-in-one modern database: MongoDB Atlas

    MongoDB Atlas provides built-in vector search and a flexible document model so developers can build, scale, and run gen AI apps without stitching together multiple databases. From LLM integration to semantic search, Atlas simplifies your AI architecture—and it’s free to get started.
    Start Free
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    haxor-news

    haxor-news

    Browse Hacker News like a haxor

    haxor-news brings Hacker News to the terminal, allowing you to view/filter the following without leaving your command line; posts, post comments, post-linked web content, monthly hiring and freelancers posts, user info, and onions. haxor-news helps you filter the large number of comments that popular posts generate. Job hunting or just curious what's out there? Filter the monthly who's hiring and freelancers post. Combine haxor-news with pipes, redirects, and other command-line utilities....
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    Note: latest version can be found at https://github.com/targeted/pythomnic3k Pythomnic3k is a Python 3 framework for service-oriented middleware with hot reloading and fault tolerance. It is used for integrating various systems in enterprise network or writing standalone network services.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Catberry

    Catberry

    Catberry is an isomorphic framework

    Catberry is an isomorphic framework for building universal front-end apps using components, Flux architecture and progressive rendering. Catberry builds a bundle for running the application in a browser as a Single Page Application. Cat-Components – similar to web-components but organized as directories, can be rendered on the server and published/installed as NPM packages. The entire architecture of the framework is built using the Service Locator pattern, which helps to manage module dependencies and create plugins, and Flux, for the data layer. Search crawler receives a full page from the server. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    SAWS

    SAWS

    A supercharged AWS command line interface (CLI)

    Although the AWS CLI is a great resource to manage your AWS-powered services, it's tough to remember the usage of 70+ top-level commands, 2000+ subcommand, countless command-specific options, and resources such as instance tags and buckets. SAWS aims to supercharge the AWS CLI with features focusing on improving ease-of-use, and increasing productivity. Under the hood, SAWS is powered by the AWS CLI and supports the same commands and command structure. In addition to the default commands,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Simple, Secure Domain Registration Icon
    Simple, Secure Domain Registration

    Get your domain at wholesale price. Cloudflare offers simple, secure registration with no markups, plus free DNS, CDN, and SSL integration.

    Register or renew your domain and pay only what we pay. No markups, hidden fees, or surprise add-ons. Choose from over 400 TLDs (.com, .ai, .dev). Every domain is integrated with Cloudflare's industry-leading DNS, CDN, and free SSL to make your site faster and more secure. Simple, secure, at-cost domain registration.
    Sign up for free
  • 5
    phoneutria
    A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Icon Font to PNG

    Icon Font to PNG

    Python script (and library) for exporting icons from icon fonts

    Python script (and library) for easy and simple export of icons from web icon fonts (e.g. Font Awesome, Octicons) as PNG images. The best part is the provided shell script, but you can also use it’s functionality directly in your (probably awesome) Python project. There’s also font-awesome-to-png script for backward compatibility with the first iteration of the concept.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    SIGAR (System Information Gatherer and Reporter) is a cross-platform, cross-language library and command-line tool for accessing operating system and hardware level information in Java, Perl and .NET.
    Leader badge
    Downloads: 35 This Week
    Last Update:
    See Project
  • 8
    CMake BASIS

    CMake BASIS

    Build system And Software Implementation Standard

    The CMake Build system And Software Implementation Standard makes it easy to create sharable software and libraries that work together. This is accomplished by combining and documenting some of the best practices and utilities available. More importantly, BASIS supplies a fully integrated suite of functionality to make the whole process seamless! Check out the web site for more information. The Git repository of this project is hosted on GitHub. Some interesting facts about this project...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 9

    mds-utils

    General purpose utilities for C++ and Python developers

    ...Amongst them, some type traits for detecting different uBLAS matrix types. 3. some useful classes that allow to treat the old C FILE pointer as a C++ stream. 4. C++ wrappers of the main Python objects, independent of those in Boost Python. Wrappers are provided also for NumPy arrays. 5. C++ classes that help on treating Python file objects as C++ streams. 6. a review and refactor of the indexing support in Python extensions. Now access in write mode is supported too. More details on the Doxygen documentation. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build Securely on Azure with Proven Frameworks Icon
    Build Securely on Azure with Proven Frameworks

    Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

    Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
    Download Now
  • 10
    angular-filemanager

    angular-filemanager

    JavaScript file manager Material Design folder explorer

    A very smart filemanager to manage your files in the browser developed in AngularJS following Material Design styles by Jonas Sciangula Street. This project provides a web file manager interface, allowing you to create your own backend connector following the connector API. By the way, we provide some example backend connectors in many languages as an example (PHP-FTP, PHP-local, python, etc). Pick files callback for third parties apps. Directory tree navigation. Copy, Move, Rename (Interactive UX). ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Quokka

    Quokka

    Quokka is a Content Management System - `docker run

    Quokka is a Content Management Framework written in Python. A lightweight framework to build CMS (Content Management System) as websites, portals, blogs, applications and anything related to publishing content to the web. Quokka is not limited to CMS area, it is also possible to create Quokka extensions to provide any kind of web application based on Python and Flask. Quokka can also (optionally) generate a static website from the contents generated in its admin interface. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Perfect: Server-Side Swift

    Perfect: Server-Side Swift

    The Perfect core toolset and framework for Swift Developers

    ...With Perfect, you can write an entire project in one language: Swift - instead of having multiple languages to contend with, like JavaScript (Node.js), Java, Ruby or Python. Use Apple’s open source Swift programming language throughout your entire development process. Whether you’re building iOS and OS X apps, or backend support for web apps, wearable technologies, and games, you don’t need to learn another programming language when you use Perfect on the server-side.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Reactive Extensions for JavaScript

    Reactive Extensions for JavaScript

    An API for asynchronous programming with observable streams

    ...The Observer pattern, the Iterator pattern, and functional programming. ReactiveX is everywhere, and it's meant for everything. Available for idiomatic Java, Scala, C#, C++, Clojure, JavaScript, Python, Groovy, JRuby, and others. Embrace ReactiveX's asynchronicity, enabling concurrency and implementation independence. Manipulate UI events and API responses, on the Web with RxJS, or on mobile with Rx.NET and RxJava. Avoid intricate stateful programs, using clean input/output functions over observable streams. ReactiveX's operators often reduce what was once an elaborate challenge into a few lines of code. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    WebDAVSurfer

    WebDAVSurfer

    WebDAV client 64-bit works with Plone 5, Apache and more

    GUI WebDAV Client for Linux and Windows 10. Includes PROPFIND, PROPPATCH, LOCK ,UNLOCK ,VERSION-CONTROL,REPORT. HTTP(S) with Basic Authentication and PKI client and server Certificates. Works with Plone, Zope, Apache + mod_dav, PyWebDAV, PyDAV, Tamino. 64-bit wxPython used. Upload files or from Web. Update properties. Tested with Plone 5.04
    Downloads: 2 This Week
    Last Update:
    See Project
  • 15
    SteppedStateMachine

    SteppedStateMachine

    Creates and operates a stepped state machine

    Implements a stepped state machine, i.e. a state machine which executes a single state transition at a time. Because of this, no data, e.g. state data, can be stored between executions. Instead, any such data must be stored in persistent storage between executions. This permits operation of the state machine as a CGI program in a web server. A WSGI or fastCGI or other such web server is not required. Received symbols may be received from sources outside the state machine, or may be...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16

    z9

    a simple client-server ERP system

    z9 is a simple client-server ERP framework, based on a Python/PyQt modular smartclient and a PHP+SQL RESTful web service, created for the "opificio zeronove" bike shop application.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Pootle, Virtaal & Translate Toolkit

    Pootle, Virtaal & Translate Toolkit

    Localization tools built by localizers for localizers

    Tools for localization: - Pootle: web based translation management system. - Virtaal: Computer Aided Translation (CAT) tool. - Translate Toolkit: QA, format conversion and support (PO, Java .properties, OpenOffice, Mozilla, XLIFF, TMX, TBX, CSV, Qt .ts).
    Leader badge
    Downloads: 82 This Week
    Last Update:
    See Project
  • 18
    Functional-Programming

    Functional-Programming

    Functional Programming concepts, examples and patterns

    This repository is a tutorial collection showcasing functional programming concepts across multiple languages (Haskell, OCaml, Scala, Scheme, Clojure, Python). It provides reusable code snippets, examples, and case studies to illustrate FP ideas in a comparative manner. The purpose of this tutorial is to illustrate functional programming concepts in many languages by providing reusable and useful snippets of code, examples, case studies and applications. The project’s web site was updated and improved with a table of contents on side-bar. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Java-based framework for decoupling back-end services and front-end interfaces. Browse and interact with a database, a class library, a network, a log file, or any live java object as though it were a filesystem. (It works with filesystems too!)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    C++ Simulated Travel Distribution System
    That project aims at providing a clean API and a simple implementation, as a C++ library, of a Travel-oriented Distribution System. It corresponds to the simulated version of the real-world Computerized Reservation Systems (CRS).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    C++ Airline Inventory Management Library
    That project aims at providing a clean API and a simple implementation, as a C++ library, of an Airline-related Inventory Management system. That library uses the Standard Airline IT C++ object model (http://sf.net/projects/stdair).
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Open Airline Revenue Accounting
    That project aims at delivering a reference implementation of a library, estimating and serving average prices paid for air travel products. It is not intended for use by an actual airline, but rather by simulators or other airline-related modules of
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Node Crawler

    Node Crawler

    Web Crawler/Spider for NodeJS + server-side jQuery

    Most powerful, popular and production crawling/scraping package for Node, happy hacking.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    DoCookBook

    DoCookBook

    Cookbook Style Document for DocBook Customizations

    This project has been moved to GitHub: https://github.com/tomschr/dbcookbook/ The DoCookBook project aims to create an open source book about DocBook and the DocBook XSL stylesheets written as a cookbook and released under a Creative Commons license.
    Downloads: 1 This Week
    Last Update:
    See Project