Showing 18 open source projects for "python web crawler"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Veeam Data Platform v13.1 - Get Your Free Trial Icon
    Veeam Data Platform v13.1 - Get Your Free Trial

    Secure by design, portable by default. Recover clean, fast, anywhere. Start a free trial.

    Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
    Try it Free
  • 1
    Spider

    Spider

    High-performance Rust web crawler and scraper for large-scale data

    Spider is a high-performance web crawler and web scraping library written in Rust that enables developers to crawl and index websites efficiently. It focuses on speed, concurrency, and reliability by using asynchronous and multi-threaded processing to handle large volumes of web pages. It can rapidly crawl websites to collect links, retrieve page content, and extract structured information from HTML documents.
    Downloads: 5 This Week
    Last Update:
    See Project
  • 2
    MusicGPT

    MusicGPT

    Generate music based on natural language prompts using LLMs

    ...The application currently integrates with models such as MusicGen and is designed to support additional models transparently in the future. In addition to a command-line interface, the project includes a web-based interface that enables conversational interaction with the AI model.
    Downloads: 83 This Week
    Last Update:
    See Project
  • 3
    rnet

    rnet

    Python HTTP client with TLS and HTTP/2 fingerprint emulation support

    rnet is an ergonomic and modular Python HTTP client designed for developers who need advanced control over network requests and protocol behavior. It provides a flexible API for making HTTP requests while supporting both asynchronous and blocking workflows, allowing it to integrate easily into different Python applications and runtimes. rnet focuses on low-level protocol customization, giving users fine-grained control over TLS and HTTP/2 configuration in order to emulate specific browser...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Phonon

    Phonon

    Phonon TTS inference using xn

    ...Its streaming architecture produces audio progressively to minimize playback delays. Hardware acceleration includes Apple Core ML, compatible Snapdragon NPUs, and GPU backends. Phonon integrates through Python, Swift, Rust, JavaScript, Android libraries, and OpenAI-compatible speech APIs.
    Downloads: 17 This Week
    Last Update:
    See Project
  • Paessler: Easy to Use With Enterprise Power. Free Trial Icon
    Paessler: Easy to Use With Enterprise Power. Free Trial

    A low-code dashboard makes monitoring intuitive for any admin, while scripting and custom sensors give experts full control.

    You shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
    Get Free Download
  • 5
    Every Code

    Every Code

    Local AI coding agent CLI with multi-agent orchestration tools

    Every Code (often referred to simply as Code) is a fast, local AI-powered coding agent designed to run directly in the terminal environment. It is a community-driven fork of the Codex CLI, with a strong emphasis on improving real-world developer ergonomics and workflows. Every Code enhances the traditional coding assistant model by introducing multi-agent orchestration, allowing multiple AI agents to collaborate, compare solutions, and refine outputs in parallel. It supports integration with...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 6
    authoscope

    authoscope

    Scriptable network authentication cracker (formerly `badtouch`)

    authoscope is a scriptable network authentication cracker. While the space for common service bruteforce is already very well saturated, you may still end up writing your own python scripts when testing credentials for web applications. The scope of authoscope is specifically cracking custom services. This is done by writing scripts that are loaded into a lua runtime. Those scripts represent a single service and provide a verify(user, password) function that returns either true or false. Concurrency, progress indication, and reporting is magically provided by the authoscope runtime.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    MooseStack

    MooseStack

    The developer framework for building analytical backends

    MooseStack is an opinionated starter stack that assembles a modern web application foundation—project structure, build tooling, and deployment scripts—so teams can get from “blank repo” to a working product quickly. It provides a coherent layout for server and client code, standardizes environment configuration, and includes scripts to run the app locally with the same conventions you’ll use in staging or production. The stack favors convention over configuration: common decisions around...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    RMCProfile

    RMCProfile

    Big box modeling for total scattering via the Reverse Monte Carlo

    Leader badge
    Downloads: 339 This Week
    Last Update:
    See Project
  • 9
    HackerOS

    HackerOS

    HackerOS based on Debian testing.

    HackerOS is based on Debian Testing, but the LTS and Cybersecurity editions are Debian Stable. HackerOS includes several GUI/CLI tools. The distribution is intended for: cybersecurity, daily use, and gaming.
    Leader badge
    5.0 out of 5 stars 1 Review
    Downloads: 600 This Week
    Last Update:
    See Project
  • 99.99% Uptime for MySQL and PostgreSQL Databases Icon
    99.99% Uptime for MySQL and PostgreSQL Databases

    Sub-second maintenance. 2x read/write performance. Built-in vector search for AI apps.

    Cloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
    Start Free
  • 10
    TeleDrive

    TeleDrive

    Unlimited Telegram cloud drive across 5 platforms & 11 languages.

    TeleDrive is a 100% open-source virtual cloud filesystem that turns private Telegram storage channels into an unthrottled, unlimited personal cloud drive with zero monthly subscription fees. Connect directly to Telegram MTProto 2.0 datacenters with zero relay servers and zero cloud storage bills. Key Highlights: • Zero Monthly Rent: Unlimited file storage via private Telegram channels. • 5 Native Platforms: Builds for macOS (DMG), Windows (EXE/MSI), Linux (AppImage/DEB/RPM), Android...
    Leader badge
    4.0 out of 5 stars 3 Reviews
    Downloads: 3,485 This Week
    Last Update:
    See Project
  • 11
    cronwatch

    cronwatch

    CronWatch records every run of your scheduled jobs in your database

    CronWatch records every run of your scheduled jobs in your own database, and speaks up when one is missed, fails, gets stuck, runs slow, or costs too much. It is a library, not a service. No server to run, no account to make, and run history that stays in your database. An alert carries the error and the last lines of output to the channels you pick, and to Anthropic only if you turn on triage.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Shinkai: Local AI Agents

    Shinkai: Local AI Agents

    Shinkai allows you to create advanced AI (local) agents effortlessly

    Shinkai is a free, open-source AI platform that lets anyone create powerful AI agents without coding. These agents can collaborate with each other, handle complex tasks, and operate in decentralized crypto environments. Key Features: - No-Code Agent Creation - Build specialized agents (trading bots, sentiment trackers, etc.) with simple descriptions - Multi-Agent Collaboration - Agents work together to solve complex problems - Crypto Integration - Built-in support for decentralized...
    5.0 out of 5 stars 6 Reviews
    Downloads: 4 This Week
    Last Update:
    See Project
  • 13
    YTS Terminal Manager

    YTS Terminal Manager

    Terminal Manager: Your All-in-One Remote Management Solution

    YTS Terminal Manager is an all-in-one terminal and remote-session manager for Windows 10 and 11. It handles SSH, Telnet, serial (RS-232/RS-485), SFTP, FTP, SCP and RDP connections as tabs in a single window, so the console cable, the jump host, the file transfer and the device web UI all live in one place and share the same favorites, logging and shortcuts. A built-in AI assistant reads your live terminal, understands the device you are connected to, and can diagnose problems, explain...
    Downloads: 11 This Week
    Last Update:
    See Project
  • 14
    Mineset

    Mineset

    OpenSRC collection of Italian school webapps and personal portfolio!

    🌟 Benvenuti nel Mondo del Portale 🌟 Il portale Mineset è nato quasi per gioco 🎮, ma nel corso degli anni si è trasformato in un progetto open source ricco di contenuti educativi e creativi. Qui troverete: • Webapp scolastiche e strumenti didattici • Videogiochi educativi 🎮 • Contenuti interattivi, anime 🌸 e racconti filosofici 📚 Tutti progettati per intrattenere, ispirare e stimolare la curiosità. ✨ Un Viaggio Interattivo ✨ Ogni sezione racconta una storia unica 📖, con easter...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 15
    llm-chain

    llm-chain

    Rust crate for building chains in large language models

    ...Incorporates support for Stanford's Alpaca models, expanding the range of available language models for advanced AI applications. Enhance your AI agents' capabilities by giving them access to various tools, such as running Bash commands, executing Python scripts, or performing web searches.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Ansible Examples

    Ansible Examples

    A few starter examples of ansible playbooks, to show features

    This repository collects practical, real-world examples of using Ansible to automate infrastructure, deployments, and configurations. Each directory demonstrates a specific use case—ranging from setting up web servers, load balancers, and databases to orchestrating multi-tier applications in cloud environments. The examples highlight common Ansible practices such as organizing inventories, writing reusable playbooks, using roles, and handling variables and templates. They’re designed to be...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Decentralized Internet

    Decentralized Internet

    SDK for building decentralized web and distributed computing projects

    This project was created in order to support a new internet. One that is more open, free, and censorship-resistant in comparison to the old internet. An internet that eventually wouldn't need to rely on telecom towers, an outdated grid, or all these other "old school" forms of tech. We believe P2P compatibility is an important part of the future of the net. Grid Computing also plays a role in having a better means of transferring information in a speedy, more cost-efficient and reliable manner.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 18
    TxPB

    TxPB

    TemporalX gRPC and Documentation Resources

    TxPB is the main source of information for using TemporalX, and includes protocol buffer definitions, generated code, and documentation. If you are looking for the protocol buffer definitions, check the pb folder. If you want bindings in other languages, feel free to open a github issue. Alternatively you can generate language bindings independently as long as the languages you are using support the appropriate protocol buffer and gRPC versions.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next