Showing 11 open source projects for "extensible web spider"

View related business solutions
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 1
    ZAP

    ZAP

    The OWASP ZAP core project

    The OWASP Zed Attack Proxy (ZAP) is one of the world’s most popular free security tools and is actively maintained by a dedicated international team of volunteers. It can help you automatically find security vulnerabilities in your web applications while you are developing and testing your applications. It's also a great tool for experienced pentesters to use for manual security testing. ZAP is an easy to use integrated penetration testing tool for finding vulnerabilities in web...
    Downloads: 104 This Week
    Last Update:
    See Project
  • 2
    Scrapy

    Scrapy

    A fast, high-level web crawling and web scraping framework

    Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring...
    Downloads: 17 This Week
    Last Update:
    See Project
  • 3
    Kieker

    Kieker

    Software Monitoring Framework

    Kieker is a framework for continuous monitoring and dynamic analysis of distributed software systems. Being designed for continuous operation, it induces only a low overhead. The TraceAnalysis tool allows to analyze and visualize trace information.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 4
    ZenTao project management software

    ZenTao project management software

    Open source Scrum tool and an ALM solution

    ZenTao is an open source Scrum tool for application development projects with features including Backlog Management✓ Sprint and task✓ bug tracking✓ Scrum✓ Waterfall✓ Roadmap✓ Burndown✓ Kanban✓ SaaS✓ Self Hosting✓
    Leader badge
    Downloads: 2,259 This Week
    Last Update:
    See Project
  • Earn up to 16% annual interest with Nexo. Icon
    Earn up to 16% annual interest with Nexo.

    Access competitive interest rates on your digital assets.

    Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
    Get started with Nexo.
  • 5
    phoneutria
    A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Aigrette

    Aigrette

    HTML5 Browser automation tool

    HTML5 Browser automation tool Extensible for testing large range of web UI including JS RIA frontends. Get documentation at http://sourceforge.net/p/aigrette/wiki/Home/
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7

    sitecheck

    Modular web site spider for web developers.

    More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8

    LoadMonger

    Java based load testing tool for HTTP applications.

    Load - the demand on the operating resources of a system (as a telephone exchange or a web service) Monger - a dealer in or trader of a commodity LoadMonger - a command line Java based tool that provides a balance between ease of use and flexibility to define reasonably complex load patterns and can generate loads comparable with Apache bench, but with the ability to define more sophisticated load patterns and sophisticated data compilation via log files that can be merged on test end...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    TestFarm is a client-server Python app that allows monitoring the stability and efficiency of a devel project by performing continuous builds and tests in multiple platforms. The overall idea is based on Tinderbox. With a simpler and extensible approach.
    Downloads: 0 This Week
    Last Update:
    See Project
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New to Google Cloud? Get $300 in credits to explore Compute Engine, BigQuery, Cloud Run, Gemini Enterprise Agent Platform, and more.

    Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
    Claim $300 Free
  • 10
    This tool supports the implementation of Checklist using objective criteria to evaluate any characteristic. The Spider-CL was developed in the Software Quality context, but it can be used in any one.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    BugHunt Project's aim is to be a simple yet useful and easily extensible bug tracking system. Its architecture will provide a basic set of functionalities along with a concise framework for extending its capabilities.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next