Search Results for "web crawler source code" - Page 2

Showing 232 open source projects for "web crawler source code"

View related business solutions
  • Try Google Cloud Risk-Free With $300 in Credit Icon
    Try Google Cloud Risk-Free With $300 in Credit

    No hidden charges. No surprise bills. Cancel anytime.

    Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
    Start Free
  • Enterprise-grade ITSM, for every business Icon
    Enterprise-grade ITSM, for every business

    Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

    Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
    Try it Free
  • 1
    eslint-plugin-compat

    eslint-plugin-compat

    Check the browser compatibility of your code

    Lint the browser compatibility of your code. Browser targets are configured using a browser list. You can configure browser targets in your package.json. If no configuration is found, browser list defaults to "> 0.5%, last 2 versions, Firefox ESR, not dead". Add polyfills to the settings section of your eslint config. Append the name of the object and the property if one exists. Toolchains for native platforms, like iOS and Android, have had API linting from the start. It's about time that...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 2
    Hono

    Hono

    Web framework built on Web Standards

    Hono is a small, simple, and ultrafast web framework built on Web Standards. It works on any JavaScript runtime: Cloudflare Workers, Fastly Compute, Deno, Bun, Vercel, AWS Lambda, Lambda@Edge, and Node.js. The router RegExpRouter is really fast. The hono/tiny preset is under 14kB. Using only Web Standard APIs. Works on Cloudflare, Fastly, Deno, Bun, AWS, or Node.js. The same code runs on all platforms. Hono has built-in middleware, custom middleware, third-party middleware, and helpers....
    Downloads: 5 This Week
    Last Update:
    See Project
  • 3
    Testcontainers node

    Testcontainers node

    Supports tests, providing lightweight, throwaway instances of database

    Testcontainers is an open source library for providing throwaway, lightweight instances of databases, message brokers, web browsers, or just about anything that can run in a Docker container. No more need for mocks or complicated environment configurations. Define your test dependencies as code, then simply run your tests and containers will be created and then deleted.
    Downloads: 12 This Week
    Last Update:
    See Project
  • 4
    JHipster

    JHipster

    Development platform to generate and deploy modern web apps

    JHipster is a development platform to quickly generate, develop, and deploy modern web applications and microservice architectures. We support many frontend technologies, including Angular, React, and Vue. We even have mobile app support for Ionic and React Native! On the backend, we support Spring Boot (with Java or Kotlin), Micronaut, Quarkus, Node.js, and .NET. For deployment, we embrace cloud native principles with Docker and Kubernetes. Deployment support exists for AWS, Azure, Cloud...
    Downloads: 7 This Week
    Last Update:
    See Project
  • Full-stack observability with actually useful AI | Grafana Cloud Icon
    Full-stack observability with actually useful AI | Grafana Cloud

    Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

    Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
    Create free account
  • 5
    Fable

    Fable

    F# to JavaScript compiler

    Type inference provides robustness and correctness, but without the cost of additional code. Let the compiler catch bugs for you. Fable produces readable JavaScript code compatible with ES2015 standards and popular tooling like Webpack. Call JavaScript from Fable or Fable from JS. Use NPM packages. The entire JavaScript ecosystem is at your fingertips. Choose your favorite tool, from Visual Studio Code to JetBrains Rider. Fable supports the F# core library and some common .NET libraries to...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 6
    LaVague

    LaVague

    Framework for building AI agents that automate complex web tasks

    LaVague is an open source framework designed to help developers build AI-powered web agents capable of automating tasks across websites and web applications. It implements the concept of a Large Action Model framework, allowing agents to interpret a user-provided objective and translate it into a sequence of actions performed in a browser. These agents can navigate web pages, retrieve information, fill out forms, and execute multi-step workflows automatically. ...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 7
    xterm.js

    xterm.js

    A terminal for the web

    xterm.js is a TypeScript-based front-end terminal emulation component that lets web applications embed fully-featured terminal interfaces. It powers in-browser terminals in tools like VS Code and browser IDEs. Xterm.js works with most terminal apps such as bash, vim, and tmux, including support for curses-based apps and mouse events. Xterm.js is really fast, it even includes a GPU-accelerated renderer. Xterm.js is not a terminal application that you can download and use on your computer....
    Downloads: 9 This Week
    Last Update:
    See Project
  • 8
    The Vibe Companion

    The Vibe Companion

    Open-source Claude Code/Codex Web UI

    The Companion project by The-Vibe-Company is an open-source web-based UI for interacting with Claude Code, offering a fully graphical interface to launch sessions, stream responses, and approve or deny AI tool usage—all via web browsers on desktop or mobile. Instead of working solely through a command-line interface, developers and creators can start, manage, and visualize Claude Code sessions in a modern web environment built with TypeScript, enabling more natural interaction with AI models. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Eclipse GLSP

    Eclipse GLSP

    Graphical language server platform for building web-based diagram

    ...GLSP provides integration layers, to use GLSP editors seamlessly in web pages, Eclipse Theia, VS Code and even Eclipse desktop. GLSP provides the perfect basis for the efficient development of web-based diagram editors including edit functionality, layouting, shapes, palettes and everything else you expect from a powerful, modern diagram editor. GLSP doesn't hide the underlying rendering technologies, such as Eclipse Sprotty, SVG, and CSS.
    Downloads: 2 This Week
    Last Update:
    See Project
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Try it free
  • 10
    Foal

    Foal

    Full-featured Node.js framework, with no complexity

    It provides a set of ready-to-use components so you don't have to reinvent the wheel every time. In one single place, you have a complete environment to build web applications. This includes a CLI, testing tools, frontend utilities, scripts, advanced authentication, ORM, deployment environments, GraphQL and Swagger API, AWS utilities, and more. You no longer need to get lost on npm searching for packages and making them work together. All is provided. But while offering all these features,...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 11
    NextJS Ollama LLM UI

    NextJS Ollama LLM UI

    Fully-featured web interface for Ollama LLMs

    NextJS Ollama LLM UI is a web-based frontend interface built with Next.js to make interacting with Ollama-hosted large language models easy and fast. Its goal is to remove the complexity of setting up and managing UI components for local or offline LLM usage by providing a straightforward chat experience with support for responsive layouts, light and dark themes, and local chat history storage in the browser. The interface stores conversations in local storage, so no separate backend...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 12
    Shannon

    Shannon

    Fully autonomous AI hacker to find actual exploits in your web apps

    Shannon is an autonomous AI penetration testing system built to find and prove real, exploitable vulnerabilities in web applications rather than stopping at static warnings or best-guess alerts. It focuses on “proof by exploitation,” meaning it actively hunts for attack vectors in your code and then attempts to execute end-to-end exploits to demonstrate impact. The project blends source-aware analysis with automated web interaction so it can validate issues like injection flaws, authentication bypasses, and other exploitable paths in a way that resembles an actual attacker’s workflow. ...
    Downloads: 24 This Week
    Last Update:
    See Project
  • 13
    Claude Subconscious

    Claude Subconscious

    Give Claude Code a subconscious

    Claude Subconscious is an experimental plugin that enhances AI coding workflows by introducing a persistent “memory layer” for Claude Code through integration with Letta’s agent framework. It operates as a background agent that continuously observes user interactions, reads project files, and processes session transcripts to build long-term contextual memory. Unlike standard AI interactions that reset between sessions, this system accumulates knowledge over time, allowing it to recall user...
    Downloads: 8 This Week
    Last Update:
    See Project
  • 14
    WireGuard Easy

    WireGuard Easy

    The easiest way to run WireGuard VPN + Web-based Admin UI

    WireGuard Easy is a streamlined solution for deploying and managing a WireGuard VPN server through a web-based interface, designed to eliminate the complexity typically associated with manual VPN configuration. It combines the WireGuard backend with a user-friendly admin dashboard, allowing users to control clients, monitor connections, and generate configuration files without interacting directly with command-line tools. The project is commonly deployed using Docker, making installation...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 15
    Groq AppGen

    Groq AppGen

    Project showcasing Llama 3.3 70B HTML codegen abilities

    Groq AppGen is an interactive web application (built with Next.js and TypeScript) that uses Groq’s LLM API to generate or modify web application code based on natural-language prompts. Essentially, you tell the app what kind of web app or page you want (in plain English), and groq-appgen will produce HTML/JSX code scaffolding, layout, and optionally application logic accordingly. It supports iterative feedback: you can refine your prompt, adjust parameters or requirements, and have the app...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    Onlook

    Onlook

    The Cursor for Designers • An Open-Source AI-First Design tool

    Seamlessly integrate with any website or web app running on React + TailwindCSS, and make live edits directly in the browser DOM. Customize your design, control your codebase, and push changes your changes without compromise. Link Onlook to your React project with just one command. Run this command on your project's root folder to get set up in seconds. Onlook writes reliable code you can trust, exactly where it needs to go. Adjust layouts, change colors, modify text, and more.
    Downloads: 19 This Week
    Last Update:
    See Project
  • 17
    Theia

    Theia

    Cloud & Desktop IDE Platform

    ...It supports VS code extensions, and is completely open source and vendor neutral.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 18
    Claude Run

    Claude Run

    A beautiful web UI for browsing Claude Code conversation history

    Claude Run is a user-friendly web interface for browsing, searching, and managing Claude Code conversation history in a visually appealing way, making it easier to revisit past interactions, track project progress, and resume long-running coding sessions. Running locally via a single command (npx claude-run), it launches a web UI that displays all stored Claude Code sessions – including conversation threads, tool calls, and timestamps – in a clean chat layout, helping developers quickly find...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Flagpack

    Flagpack

    Flagpack contains 250+ flag icons to easily use within your code

    flagpack-core is a collection of high-quality SVG and PNG flags for over 250 countries and regions. It provides a lightweight and accessible way to integrate country flags into web applications.
    Downloads: 9 This Week
    Last Update:
    See Project
  • 20
    Ant Design Mobile RN

    Ant Design Mobile RN

    Ant Design for React Native

    A configurable Mobile UI specification and React-based implementation. Follow Ant Design Mobile UI specification. Configurable UI style for different products. Support web and native usages based on React Native. Develop in TypeScript. Provides 40+ basic components, covering all kinds of scenarios, component features rich to meet the needs of various functional Requirements. Simple enough to get started, you can load all the code at a time or only load some of the components used in the code...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 21
    Claude-Mem

    Claude-Mem

    Claude Code plugin that automatically captures everything Claude does

    Claude-Mem is a persistent memory compression system built specifically for Claude Code to preserve context across coding sessions. It automatically captures Claude’s tool usage, observations, and decisions, then compresses them into semantic memories that carry forward into future sessions. By enabling long-term continuity, Claude-Mem helps Claude “remember” project history, past fixes, and prior reasoning even after restarts or reconnects. Its progressive disclosure approach intelligently...
    Downloads: 18 This Week
    Last Update:
    See Project
  • 22
    OpenSumi

    OpenSumi

    A framework helps you quickly build Cloud or Desktop IDE products

    A framework helps you quickly build Cloud or Desktop IDE products. Integrate with your coding frameworks with ease. Support the container, Electron and front-end frameworks. Also help to ship and deploy quickly. Support VS Code plugins, OpenSumi plugins and OpenSumi modules to meet various business requirements. Customize the UI design in any way you like, no matter to simply configure the built-in UI, or develop a UI template, or build your own UI through plugins. OpenSumi framework aims to...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 23
    Tamagui

    Tamagui

    Style React fast with 100% parity on React Native

    Tamagui is a cross-platform UI framework and styling system for React and React Native that enables developers to build high-performance applications with a single codebase shared across web and mobile platforms. It combines a universal style system with a powerful optimizing compiler that transforms styled components into efficient, platform-specific output, significantly improving runtime performance. The framework provides a superset of the React Native styling API, allowing developers to...
    Downloads: 19 This Week
    Last Update:
    See Project
  • 24
    OpenAI.fm

    OpenAI.fm

    Code for openai.fm, a demo for the OpenAI Speech API

    OpenAI.fm is an official interactive demo application built to showcase the OpenAI Speech API and its advanced text-to-speech capabilities, providing developers and creators with a hands-on web interface to convert text into high-quality, customizable audio using state-of-the-art TTS models. Developed using Next.js and the OpenAI Speech API, this demo illustrates how the latest neural voice models can produce natural, expressive speech with adjustable styles and voices, highlighting features...
    Downloads: 26 This Week
    Last Update:
    See Project
  • 25
    webiny

    webiny

    Enterprise open-source serverless CMS

    Enterprise open-source serverless CMS. Includes a headless CMS, page builder, form builder and file manager. Easy to customize and expand. Deploys to AWS. Create GraphQL APIs, full-stack applications and websites. Deploy with single command to your AWS. Runs on services like AWS Lambda and DynamoDB. Highly-scalable & highly-available out of the box. You get a full-stack project with a GraphQL API and a React frontend that you can use to start building. Write custom apps and business logic...
    Downloads: 7 This Week
    Last Update:
    See Project
MongoDB Logo MongoDB