Showing 25 open source projects for "web crawler source code"

View related business solutions
  • AI-generated apps that pass security review Icon
    AI-generated apps that pass security review

    Stop waiting on engineering. Build production-ready internal tools with AI—on your company data, in your cloud.

    Retool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
    Try Retool free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    Roo Code

    Roo Code

    Roo Code gives you a whole dev team of AI agents in your code editor

    Roo Code is an AI-powered software engineering platform that works interactively in your IDE and autonomously in the cloud to help teams ship faster. It combines a powerful VS Code extension with cloud-based agents that can take on real development tasks across GitHub, Slack, and the web. Designed to work on your terms, Roo Code gives you full control locally while enabling delegation and parallel execution at scale.
    Downloads: 19 This Week
    Last Update:
    See Project
  • 2
    Forge Code

    Forge Code

    AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek

    Forge is a modern, open-source tool that brings AI-powered code assistance directly into your terminal workflow, effectively turning your shell into a “pair programmer”, without ever leaving your development environment. Written in Rust (with a command-line interface), Forge integrates with your existing shell (bash, zsh, fish, etc.) or IDE-agnostic workflows, allowing you to interact with your codebase, command-line tools, and version control as usual, but with the added support of large language models (LLMs) to help with code generation, refactoring, bug fixing, code review, and even design advice. ...
    Downloads: 10 This Week
    Last Update:
    See Project
  • 3
    Happy Coder

    Happy Coder

    Mobile and Web client for Codex and Claude Code, with realtime voice

    Happy is an open-source, cross-platform mobile and web client designed to bring powerful AI coding agents such as Claude Code and Codex to your fingertips no matter where you are. At its core, Happy wraps existing AI coding tools with a unified interface, providing real-time voice interactions, encrypted communication, and seamless device switching between desktop and mobile.
    Downloads: 29 This Week
    Last Update:
    See Project
  • 4
    Omnara

    Omnara

    Talk to Your AI Agents from Anywhere

    Omnara is an open-source agent control platform that empowers developers to turn autonomous AI tools (e.g., Claude Code, Cursor, GitHub Copilot) into collaborative teammates by offering real-time dashboards, push notifications, and remote guidance across terminals, web, and mobile. Omnara transforms your AI agents (Claude Code, Codex CLI, n8n, and more) from silent workers into communicative teammates.
    Downloads: 16 This Week
    Last Update:
    See Project
  • $300 in Free Credit Towards Top Cloud Services Icon
    $300 in Free Credit Towards Top Cloud Services

    Build VMs, containers, AI, databases, storage—all in one place.

    Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
    Get Started
  • 5
    AutoMaker

    AutoMaker

    Start directing AI agents

    Automaker is an autonomous AI development studio designed to transform how software is built by allowing developers to describe features, then watching AI agents implement code, tests, commits, and more with minimal manual typing. Instead of writing every line of code by hand, users add feature cards to a Kanban board with natural language descriptions, and AI agents powered by the Claude Agent SDK handle multi-step tasks such as planning, generating code, running tests, and committing to an...
    Downloads: 19 This Week
    Last Update:
    See Project
  • 6
    Brokk

    Brokk

    Brokk brings code intelligence to AI

    Brokk is a code intelligence assistant framework designed to let large language models (LLMs) understand code semantically (not just as raw text) so that they can work effectively on large codebases that don’t fit wholly in a prompt context. It helps bridge the gap between LLMs and real-world engineering code by offering tooling to index, analyze, query, and augment code context, so that AI can meaningfully reason about existing code, suggest edits, and navigate across projects. Modular...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 7
    Onlook

    Onlook

    The Cursor for Designers • An Open-Source AI-First Design tool

    Seamlessly integrate with any website or web app running on React + TailwindCSS, and make live edits directly in the browser DOM. Customize your design, control your codebase, and push changes your changes without compromise. Link Onlook to your React project with just one command. Run this command on your project's root folder to get set up in seconds. Onlook writes reliable code you can trust, exactly where it needs to go. Adjust layouts, change colors, modify text, and more.
    Downloads: 22 This Week
    Last Update:
    See Project
  • 8
    Groq AppGen

    Groq AppGen

    Project showcasing Llama 3.3 70B HTML codegen abilities

    Groq AppGen is an interactive web application (built with Next.js and TypeScript) that uses Groq’s LLM API to generate or modify web application code based on natural-language prompts. Essentially, you tell the app what kind of web app or page you want (in plain English), and groq-appgen will produce HTML/JSX code scaffolding, layout, and optionally application logic accordingly. It supports iterative feedback: you can refine your prompt, adjust parameters or requirements, and have the app...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    DevoxxGenie

    DevoxxGenie

    DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's

    Devoxx Genie is a fully Java-based LLM Code Assistant plugin for IntelliJ IDEA, designed to integrate with local LLM providers such as Ollama, LMStudio, GPT4All, Llama.cpp, and Exo but also cloud-based LLMs such as OpenAI, Anthropic, Mistral, Groq, Gemini, DeepInfra, DeepSeek, OpenRouter and Azure OpenAI.
    Downloads: 14 This Week
    Last Update:
    See Project
  • Gemini 3 and 200+ AI Models on One Platform Icon
    Gemini 3 and 200+ AI Models on One Platform

    Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

    Build generative AI apps with Vertex AI. Switch between models without switching platforms.
    Start Free
  • 10
    GPT All Star

    GPT All Star

    AI-powered code generation tool for scratch development of web apps

    AI-powered code generation tool for scratch development of web applications with a team collaboration of autonomous AI agents. This is a research project, and its primary value is to explore the possibility of autonomous AI agents.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Claude-Mem

    Claude-Mem

    Claude Code plugin that automatically captures everything Claude does

    Claude-Mem is a persistent memory compression system built specifically for Claude Code to preserve context across coding sessions. It automatically captures Claude’s tool usage, observations, and decisions, then compresses them into semantic memories that carry forward into future sessions. By enabling long-term continuity, Claude-Mem helps Claude “remember” project history, past fixes, and prior reasoning even after restarts or reconnects. Its progressive disclosure approach intelligently...
    Downloads: 18 This Week
    Last Update:
    See Project
  • 12
    Aider

    Aider

    Aider is AI pair programming in your terminal

    Aider is an AI pair programming tool that runs directly in your terminal, helping developers build new projects or extend existing codebases faster and more confidently. It works alongside you like a coding partner, using powerful large language models to understand your code and implement precise changes. Aider creates a structured map of your entire repository, allowing it to handle large and complex projects effectively. It supports over 100 programming languages, making it flexible for...
    Downloads: 14 This Week
    Last Update:
    See Project
  • 13
    VibeSDK

    VibeSDK

    Open source full-stack AI vibe coding platform & web app generator

    VibeSDK is an open source “vibe coding” platform. VibeSDK is a project built by Cloudflare. It provides a full-stack reference implementation of an AI-driven system. Users describe the application they want in natural language, and the system generates, previews, and deploys the resulting web app. It uses Cloudflare’s infrastructure (Workers, Containers, sandboxes).
    Downloads: 8 This Week
    Last Update:
    See Project
  • 14
    Taipy

    Taipy

    Turns Data and AI algorithms into production-ready web applications

    From simple pilots to production-ready web applications in no time. No more compromise on performance, customization, and scalability. Taipy enhances performance with caching control of graphical events, optimizing rendering by selectively updating graphical components only upon interaction. Effortlessly manage massive datasets with Taipy's built-in decimator for charts, intelligently reducing the number of data points to save time and memory without losing the essence of your data's shape....
    Downloads: 11 This Week
    Last Update:
    See Project
  • 15
    HolyClaude

    HolyClaude

    AI coding workstation: Claude Code + web UI + 5 AI CLIs + headless

    HolyClaude is a developer-focused toolkit designed to enhance and extend the capabilities of Claude Code environments by providing structured prompts, utilities, and workflow enhancements for AI-assisted coding. The project centers around improving how developers interact with AI agents, enabling more efficient code generation, debugging, and task execution through optimized prompt engineering. It includes predefined templates and interaction patterns that guide the AI toward producing more...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 16
    OpenCode

    OpenCode

    The open source coding agent

    OpenCode is an open-source AI coding agent designed to assist developers directly from the terminal, desktop, or IDE environments. It functions as a locally running assistant that can analyze codebases, execute development tasks, and interact with external tools while remaining highly configurable. The system is built around an agent model that can perform actions such as file manipulation, shell execution, and web access with user confirmation. Its provider-agnostic design allows developers...
    Downloads: 82 This Week
    Last Update:
    See Project
  • 17
    OpenHands

    OpenHands

    Open-source autonomous AI software engineer

    ...So we're building all our agents in the open on GitHub, under the MIT license. Our agents can do anything a human developer can: they write code, run commands, and use the web. We're partnering with AI safety experts like Invariant Labs to balance innovation with security.
    Downloads: 10 This Week
    Last Update:
    See Project
  • 18
    MiniMax-M2.5

    MiniMax-M2.5

    State of the art LLM and coding model

    MiniMax-M2.5 is a state-of-the-art foundation model extensively trained with reinforcement learning across hundreds of thousands of real-world environments. It delivers leading performance in coding, agentic tool use, search, and complex office workflows, achieving top benchmark scores such as 80.2% on SWE-Bench Verified and 76.3% on BrowseComp. Designed to reason efficiently and decompose tasks like an experienced architect, M2.5 plans features, structure, and system design before...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 19
    SWE-agent

    SWE-agent

    SWE-agent takes a GitHub issue and tries to automatically fix it

    SWE-agent turns LMs (e.g. GPT-4) into software engineering agents that can resolve issues in real GitHub repositories. On the SWE-bench, the SWE-agent resolves 12.47% of issues, achieving state-of-the-art performance on the full test set. We accomplish our results by designing simple LM-centric commands and feedback formats to make it easier for the LM to browse the repository, and view, edit, and execute code files. We call this an Agent-Computer Interface (ACI).
    Downloads: 7 This Week
    Last Update:
    See Project
  • 20
    Modelence

    Modelence

    Modelence is an all-in-one TypeScript platform

    Modelence is an all-in-one TypeScript platform aimed at helping teams ship production web apps with far less boilerplate than a typical full-stack setup. It positions itself as a Supabase-style experience tailored toward MongoDB-centric development, bundling common backend needs like authentication, database integration, and observability into a cohesive framework. The project is built to support modern application workflows where product teams want to move quickly without stitching together...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 21
    VibeKit

    VibeKit

    Run Claude Code, Gemini, Codex in a clean, isolated sandbox

    Vibekit is an open-source toolkit focused on rapid prototyping and building of AI-driven experiences, particularly those that integrate multimodal inputs, reactive interfaces, and context-aware behaviors. It provides a set of abstractions and utilities that let developers connect generative models to UI frameworks, sensors, event streams, and external services without having to build plumbing from scratch. Instead of treating AI models as black boxes behind simple prompts, Vibekit encourages...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Mermaid.js to SVG Converter

    Mermaid.js to SVG Converter

    Visualize the diagrams of your projects

    ...The trick is to ask the AI to write a diagram in Mermaid.js format that solidifies the structure of the project and then use that as context to keep the AI reminded at all times what the project is as a whole. This will prevent it from changing things its not supposed to change. This standalone offline web app will convert that mermaid.js code into a visual SVG image so that YOU as a human will be able to understand what the AI think about the structure of your projects so you can see it and fix any misconceptions until the diagram is correct for your project. (Source code is included in the html itself. Open it in a web browser to use.)
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Aide

    Aide

    The open source AI-native IDE

    Aide is an AI software engineering assistant that provides conversational code generation, analysis, and refactoring directly within your IDE or through a local web interface. Built to act as a full-stack collaborator, it understands multi-file projects, detects dependency relationships, and can generate consistent updates across files and frameworks. It supports multiple backends—including OpenAI, Anthropic, and open-source models—and can route requests based on task type or latency requirements. ...
    Downloads: 12 This Week
    Last Update:
    See Project
  • 24
    vue-tetris

    vue-tetris

    Use Vue, Vuex to code Tetris

    vue-tetris is a browser-based implementation of the classic Tetris game built using the Vue.js framework, showcasing both game development concepts and modern frontend engineering practices. The project demonstrates how reactive state management and component-based architecture can be used to create interactive and dynamic applications. It includes core gameplay mechanics such as piece rotation, collision detection, line clearing, and score tracking, all implemented within a clean and...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 25
    Luna Code Checker

    Luna Code Checker

    An advanced web-based tool for checking JavaScript code using ESLint.

    Luna Code Checker An advanced web-based tool for checking JavaScript code using ESLint. How to Use Clone the repository. Run npm install to install the dependencies. Run npm start to start the server. Open http://localhost:3000 in your web browser. Write or paste your JavaScript code in the textarea. Click the "Check Code" button to see linting results.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next
MongoDB Logo MongoDB