Showing 23 open source projects for "extensible web spider"

View related business solutions
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure Icon
    Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure

    Native application identity and user-based security for your Azure cloud

    Gain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
    Get a free trial
  • 1
    Scrapy-Redis

    Scrapy-Redis

    Redis-based components for Scrapy

    You can start multiple spider instances that share a single redis queue. Best suitable for broad multi-domain crawls. Scraped items gets pushed into a redis queued meaning that you can start as many as needed post-processing processes sharing the items queue. Scheduler + Duplication Filter, Item Pipeline, Base Spiders. Default requests serializer is pickle, but it can be changed to any module with loads and dumps functions. Note that pickle is not compatible between python versions. Version...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 2
    Lighthouse

    Lighthouse

    Automated auditing, performance metrics, & best practices for the web

    Lighthouse is an open-source, automated tool that analyzes and audits web apps and web pages in order to improve their quality. Lighthouse collects modern performance metrics and insights on developer best practices; auditing for performance, accessibility, SEO and more. After auditing it produces a report either in JSON or HTML. Included in the report is a reference doc that explains the importance of the audit and how to fix the problem areas, which you can use to improve the web app or...
    Downloads: 14 This Week
    Last Update:
    See Project
  • 3
    Open ChatGPT Atlas

    Open ChatGPT Atlas

    Open Source and Free Alternative to ChatGPT Atlas

    Open ChatGPT Atlas is an open-source toolkit and interface for working with OpenAI’s ChatGPT models in a more extensible, adaptable, and composable way than standard web UIs allow. It provides an architecture where developers and power users can manage state, tool integrations, and multi-turn workflows with more control, enabling custom UIs, automation layers, and advanced routing logic. Unlike a fixed chat app, Atlas is designed as a foundation that can be extended with plugins, external APIs, and custom logic to support domain-specific assistants, agent-like behaviors, and multi-task workflows. ...
    Downloads: 14 This Week
    Last Update:
    See Project
  • 4
    Melt UI

    Melt UI

    A set of headless, accessible component builders for Svelte

    Melt UI is an open-source headless component builder library created specifically for the Svelte ecosystem, designed to help developers construct accessible and highly customizable user interface components. Rather than providing fully styled widgets, the library focuses on supplying the behavioral logic and accessibility patterns needed to build UI components while allowing developers to control the visual appearance. Melt UI introduces a builder-based architecture where component logic is...
    Downloads: 7 This Week
    Last Update:
    See Project
  • $300 Free Credits for Your Google Cloud Projects Icon
    $300 Free Credits for Your Google Cloud Projects

    Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

    Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
    Start Free Trial
  • 5
    Mink

    Mink

    PHP web browser emulator abstraction

    Mink is an open-source PHP library that provides a browser abstraction layer for web application testing, allowing developers to simulate user interactions with websites in a consistent and flexible way. Instead of tying test logic to a specific browser driver, Mink introduces a unified API that can work with multiple drivers such as Goutte, Selenium, ChromeDriver, or BrowserKit. This abstraction enables developers to write tests once and run them across different environments without...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Lobo Evolution - Java Web Browser

    Lobo Evolution - Java Web Browser

    Lobo Evolution is an extensible all-Java web browser and RIA platform

    Lobo Evolution is a fork of Lobo Browser. The project continuing the work of Lobo Browser(lobochief). Lobo Evolution is an extensible all-Java web browser and RIA platform. It supports HTML 4, HTML5 Javascript, CSS 3 and Java (Swing) rendering. CobraEvolution is the web browser's renderer API; also a Javascript-aware HTML parser. Lobo Evolution 5.0 relesed CHANGELOG: https://github.com/LoboEvolution/LoboEvolution/releases Read wiki: https://loboevolution.github.io/LoboEvolution/project-info.html Javadoc site: https://oswetto.github.io/LoboEvolution Now you can fork the project and help me with code. ...
    Leader badge
    Downloads: 4 This Week
    Last Update:
    See Project
  • 7
    Eric Integrated Development Environment

    Eric Integrated Development Environment

    Python Development Environment with all batteries included

    Eric is a Python IDE written using PyQt and QScintilla. It provides various features such as any number of open editors, an integrated (remote) debugger, project management facilities, unit test, refactoring and much more.
    Leader badge
    Downloads: 136 This Week
    Last Update:
    See Project
  • 8
    Web Spider, Web Crawler, Email Extractor

    Web Spider, Web Crawler, Email Extractor

    Free Extracts Emails, Phones and custom text from Web using JAVA Regex

    In Files there is WebCrawlerMySQL.jar which supports MySql Connection Please follow this link to get latest version https://sourceforge.net/projects/web-spider-web-crawler-extract/ Free Web Spider & Crawler. Extracts Information from Web by parsing millions of pages. Store data into Derby OR MySQL Database and data are not being lost after force closing the spider. - Free Web Spider , Parser, Extractor, Crawler - Extraction of Emails , Phones and Custom Text from Web - Export to Excel File - Data Saved into Derby Database - Written in Java Cross Platform See also Free Email Sender in this link: https://sourceforge.net/projects/gitst-free-email-ender/ Please install Microsoft OpenJDK to start the application https://www.microsoft.com/openjdk
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    generator-ngx-rocket

    generator-ngx-rocket

    Extensible Angular 13+ enterprise-grade project generator

    Extensible Angular 5+ enterprise-grade project generator based on angular-cli with best practices from the community. Bootstrap, Angular Material or even Ionic are available, just pick one and start to code. Save time and maintenance effort by creating Progressive Web App and mobile app with the same code base. The app template is based on HTML5, TypeScript and Sass.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • 10
    Browser Pool

    Browser Pool

    A Node.js library to easily manage and rotate a pool of web browsers

    ...We also wanted to easily and reliably manage the whole browser/page lifecycle. You can use Browser Pool for scraping the internet at scale, testing your website in multiple browsers at the same time or launching web automation robots.
    Downloads: 6 This Week
    Last Update:
    See Project
  • 11
    LibreWeb Browser

    LibreWeb Browser

    Decentralized Web Browser

    LibreWeb is an open-source decentralized web browser, leveraging IPFS. What would you do differently; if you could reinvent The Internet in the 21st century? With all the knowledge and new technologies available today. I was inspired by Douglas Engelbart, Tim Berners-Lee, and Ted Nelson as well as projects like IPFS, Jekyll, ARPANET, and more. Everyone should be able to easily read and create a site/blog/news page and publish the content online (without minimal technical knowledge). Built-in...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Wexond

    Wexond

    Modern and feature-rich web browser base based on Electron

    Wexond is a beautiful, open-source, extensible web browser that's focused on privacy and offers a totally new user experience. Because it's made with Electron, it's not bloated with redundant Google tracking services and only utilizes minimal resources. And thanks to its Wexond Shield powered by Cliqz, websites can load up to eight times faster, and you can freely browse the web without pesky ads or worrying about websites tracking you.
    Downloads: 9 This Week
    Last Update:
    See Project
  • 13
    Literally Canvas

    Literally Canvas

    A canvas in your browser

    Literally Canvas is an extensible, open source (BSD-licensed), HTML5 drawing widget. Its only dependency is React.js. You can use it to embed drawing boards in web pages. It’s kind of like an extensible MS Paint in JavaScript. Users can sketch drawings and you can do what you like with the results. comes with an easy-to-use jQuery plugin. It’s developed by the community for many purposes and is free to use and extend.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Nightingale

    Nightingale

    A community supported fork of the Songbird media player and library.

    Nightingale is a community created fork of the Songbird media player. It is developed by a proud community and we are equally proud to bring you the most extensible, feature-rich media experience on Windows, Mac, and Linux. See the official website at http://getnightingale.com for the source, builds, and information. On Sourceforge, we provide our releases, the binary deps for building, as well as builds for testing purposes.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 15

    jCounter

    jCounter is a simple light-weight extensible jQuery plugin that helps

    jCounter is a simple light-weight extensible jQuery plugin that helps you create various date-based countdowns, countups and custom timers. It comes with server-side timezone support to display accurate countdowns across the globe and pure css scalable themes.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Midori is a lightweight web browser.
    Downloads: 14 This Week
    Last Update:
    See Project
  • 17
    VxmlSurfer is a modular, multi-platform, extensible VoiceXML 2.0 interpreter, geared to Web browsing as opposed to telephony. VxmlSurfer is currently used as a user interface for the HearSay non-visual Web browser.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    A firefox extension that resolves an eXtensible Resource Identifier (XRI) and renders the eXtensible Resource Descriptor Set (XRDS) document in a human-friendly interface.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Pirate is a programmable API for developing complex, extensible JavaScript objects and modules.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    The goal of the project is to create a 100% pure Java-based browser support the latest standards from the W3C. This project is made up of two parts, the actual browser application written in Java Swing and a Swing component that renders HTML.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Grail is a web browser written in Python using the Tk widget set. It is designed to be highly extensible, allowing the user to extend the ste of content types that are supported. Grail is now being developed by visual-101.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 23
    Web browser form validator lib in Javascript 1.1. I wasn't satisfied with the libs I've found, so I've built mine. Deals with a lot of browsers, extensible and customizable. ERROR MESSAGES IN BRAZILIAN PORTUGUESE, but should be easy to change.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next
Auth0 Logo