10 projects for "extensible web spider" with 2 filters applied:

  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    Scrapy

    Scrapy

    A fast, high-level web crawling and web scraping framework

    Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring...
    Downloads: 20 This Week
    Last Update:
    See Project
  • 2
    Kieker

    Kieker

    Software Monitoring Framework

    Kieker is a framework for continuous monitoring and dynamic analysis of distributed software systems. Being designed for continuous operation, it induces only a low overhead. The TraceAnalysis tool allows to analyze and visualize trace information.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3
    ZenTao project management software

    ZenTao project management software

    Open source Scrum tool and an ALM solution

    ZenTao is an open source Scrum tool for application development projects with features including Backlog Management✓ Sprint and task✓ bug tracking✓ Scrum✓ Waterfall✓ Roadmap✓ Burndown✓ Kanban✓ SaaS✓ Self Hosting✓
    Leader badge
    Downloads: 2,194 This Week
    Last Update:
    See Project
  • 4
    phoneutria
    A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New to Google Cloud? Get $300 in credits to explore Compute Engine, BigQuery, Cloud Run, Gemini Enterprise Agent Platform, and more.

    Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
    Claim $300 Free
  • 5
    Aigrette

    Aigrette

    HTML5 Browser automation tool

    HTML5 Browser automation tool Extensible for testing large range of web UI including JS RIA frontends. Get documentation at http://sourceforge.net/p/aigrette/wiki/Home/
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6

    sitecheck

    Modular web site spider for web developers.

    More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7
    Madcow 2.0

    Madcow 2.0

    Madcow 2.0 - Advanced Test Automation

    Madcow Version 2.0 is the premier test automation tool designed to make your life easier. Developers love it. Testers can actually use it. Madcow is a domain specific language which helps to make it easier to test web browser based applications. You don't need to be a programmer to use it! Testers can write and organise their test cases the way the want to. It runs in the JVM as it is built using Groovy, and utilises the respected Webdriver framework. Check it out today! Please...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    TestFarm is a client-server Python app that allows monitoring the stability and efficiency of a devel project by performing continuous builds and tests in multiple platforms. The overall idea is based on Tinderbox. With a simpler and extensible approach.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    This tool supports the implementation of Checklist using objective criteria to evaluate any characteristic. The Spider-CL was developed in the Software Quality context, but it can be used in any one.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Atera - an All-in-one platform for IT management Icon
    Atera - an All-in-one platform for IT management

    Ideal for IT departments and MSPs (managed service providers)

    Your IT essentials, integrated & elevated. Take your IT management from automated to autonomous, download Atera's agent to start your free trial!
    Try Atera now
  • 10
    BugHunt Project's aim is to be a simple yet useful and easily extensible bug tracking system. Its architecture will provide a basic set of functionalities along with a concise framework for extending its capabilities.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next
Auth0 Logo