Showing 12 open source projects for "extensible web spider"

View related business solutions
  • Stop vibe-debugging. Icon
    Stop vibe-debugging.

    Plug Claude into your app's actual errors.

    AppSignal's MCP server hands Claude, Cursor, or Zed your real errors, traces, and the deploy that shipped them. AI writes the fix; you review the diff.
    Free 30 days.
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 1
    ZAP

    ZAP

    The OWASP ZAP core project

    The OWASP Zed Attack Proxy (ZAP) is one of the world’s most popular free security tools and is actively maintained by a dedicated international team of volunteers. It can help you automatically find security vulnerabilities in your web applications while you are developing and testing your applications. It's also a great tool for experienced pentesters to use for manual security testing. ZAP is an easy to use integrated penetration testing tool for finding vulnerabilities in web...
    Downloads: 114 This Week
    Last Update:
    See Project
  • 2
    Scrapy

    Scrapy

    A fast, high-level web crawling and web scraping framework

    Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring...
    Downloads: 16 This Week
    Last Update:
    See Project
  • 3
    Kieker

    Kieker

    Software Monitoring Framework

    Kieker is a framework for continuous monitoring and dynamic analysis of distributed software systems. Being designed for continuous operation, it induces only a low overhead. The TraceAnalysis tool allows to analyze and visualize trace information.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 4
    ZenTao project management software

    ZenTao project management software

    Open source Scrum tool and an ALM solution

    ZenTao is an open source Scrum tool for application development projects with features including Backlog Management✓ Sprint and task✓ bug tracking✓ Scrum✓ Waterfall✓ Roadmap✓ Burndown✓ Kanban✓ SaaS✓ Self Hosting✓
    Leader badge
    Downloads: 2,253 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 5
    phoneutria
    A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Aigrette

    Aigrette

    HTML5 Browser automation tool

    HTML5 Browser automation tool Extensible for testing large range of web UI including JS RIA frontends. Get documentation at http://sourceforge.net/p/aigrette/wiki/Home/
    Downloads: 0 This Week
    Last Update:
    See Project
  • 7

    sitecheck

    Modular web site spider for web developers.

    More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8

    LoadMonger

    Java based load testing tool for HTTP applications.

    Load - the demand on the operating resources of a system (as a telephone exchange or a web service) Monger - a dealer in or trader of a commodity LoadMonger - a command line Java based tool that provides a balance between ease of use and flexibility to define reasonably complex load patterns and can generate loads comparable with Apache bench, but with the ability to define more sophisticated load patterns and sophisticated data compilation via log files that can be merged on test end...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Madcow 2.0

    Madcow 2.0

    Madcow 2.0 - Advanced Test Automation

    Madcow Version 2.0 is the premier test automation tool designed to make your life easier. Developers love it. Testers can actually use it. Madcow is a domain specific language which helps to make it easier to test web browser based applications. You don't need to be a programmer to use it! Testers can write and organise their test cases the way the want to. It runs in the JVM as it is built using Groovy, and utilises the respected Webdriver framework. Check it out today! Please...
    Downloads: 0 This Week
    Last Update:
    See Project
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 10
    TestFarm is a client-server Python app that allows monitoring the stability and efficiency of a devel project by performing continuous builds and tests in multiple platforms. The overall idea is based on Tinderbox. With a simpler and extensible approach.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    This tool supports the implementation of Checklist using objective criteria to evaluate any characteristic. The Spider-CL was developed in the Software Quality context, but it can be used in any one.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    BugHunt Project's aim is to be a simple yet useful and easily extensible bug tracking system. Its architecture will provide a basic set of functionalities along with a concise framework for extending its capabilities.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next