Search Results for "web crawler source code" - Page 2
Sort By:
Showing 188 open source projects for "web crawler source code"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
1
Claude-Mem
Claude Code plugin that automatically captures everything Claude does
Claude-Mem is a persistent memory compression system built specifically for Claude Code to preserve context across coding sessions. It automatically captures Claude’s tool usage, observations, and decisions, then compresses them into semantic memories that carry forward into future sessions. By enabling long-term continuity, Claude-Mem helps Claude “remember” project history, past fixes, and prior reasoning even after restarts or reconnects. Its progressive disclosure approach intelligently... -
2
/last30days
Claude Code skill that researches any topic across Reddit + X
/last30days is a specialized Claude Code skill designed to research current trends and practices across Reddit, X, and the wider web from the last 30 days, synthesize that data, and produce copy-paste-ready prompts or summaries that reflect what the community is actually talking about now. Rather than returning generic model responses, it intelligently analyzes social media and community discussions to identify what’s genuinely trending or working in practice across topics ranging from... -
3
draw-a-ui
Draw wireframe sketches and generate HTML with AI vision models
...The result is an automated design-to-code workflow where rough interface ideas can quickly become functional web layouts. It is implemented as a modern web application built with Next.js and TypeScript and requires a compatible Node.js runtime to run locally. It is designed primarily as a demonstration of AI-assisted UI generation rather than a production-ready platform. -
4
Claude Subconscious
Give Claude Code a subconscious
Claude Subconscious is an experimental plugin that enhances AI coding workflows by introducing a persistent “memory layer” for Claude Code through integration with Letta’s agent framework. It operates as a background agent that continuously observes user interactions, reads project files, and processes session transcripts to build long-term contextual memory. Unlike standard AI interactions that reset between sessions, this system accumulates knowledge over time, allowing it to recall user... -
AI-generated apps that pass security reviewRetool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
-
5
mgrep
A calm, CLI-native way to semantically grep everything, like code
This project is a modern, semantic search tool that brings the simplicity of traditional command-line grep to the world of natural language and multimodal content, enabling users to search across codebases, documents, PDFs, and even images using meaning-aware queries. Built with a focus on calm CLI experiences, it lets you index and query your local files with semantic understanding, delivering results that are relevant to your intent rather than simple pattern matches, which is especially... -
6
DeepWiki Open
AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories
DeepWiki Open is an open-source, AI-powered wiki generator that automatically creates fully navigable, richly structured wiki documentation for GitHub, GitLab, or Bitbucket repositories by combining code analysis, vector embeddings, retrieval-augmented generation (RAG), and visualization tools. Users can enter a repository URL and the system will clone the project, build semantic embeddings of its codebase, extract architecture and relationships, generate human-readable documentation, and produce visual diagrams to help explain complex code structure. ... -
7
AgenticSeek
Fully Local Manus AI. No APIs, No $200 monthly bills
AgenticSeek is a fully local autonomous AI assistant designed as a privacy-focused alternative to cloud-based agent platforms. It runs entirely on the user’s hardware and can autonomously browse the web, write code, and plan multi-step tasks without sending data to external services. The system is optimized for local reasoning models and emphasizes zero cloud dependency to maintain full user control. AgenticSeek includes intelligent agent selection, allowing it to determine the best internal... -
8
OpenAI.fm
Code for openai.fm, a demo for the OpenAI Speech API
OpenAI.fm is an official interactive demo application built to showcase the OpenAI Speech API and its advanced text-to-speech capabilities, providing developers and creators with a hands-on web interface to convert text into high-quality, customizable audio using state-of-the-art TTS models. Developed using Next.js and the OpenAI Speech API, this demo illustrates how the latest neural voice models can produce natural, expressive speech with adjustable styles and voices, highlighting features... -
9
DevoxxGenie
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's
Devoxx Genie is a fully Java-based LLM Code Assistant plugin for IntelliJ IDEA, designed to integrate with local LLM providers such as Ollama, LMStudio, GPT4All, Llama.cpp, and Exo but also cloud-based LLMs such as OpenAI, Anthropic, Mistral, Groq, Gemini, DeepInfra, DeepSeek, OpenRouter and Azure OpenAI. -
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
10
StarVector
StarVector is a foundation model for SVG generation
StarVector is a multimodal foundation model designed for generating Scalable Vector Graphics (SVG) from images or textual descriptions. The system treats vector graphics creation as a code generation problem, producing SVG code that can render detailed vector images. Its architecture combines computer vision techniques with language modeling capabilities so it can understand visual inputs and textual prompts simultaneously. The model converts raster images or text instructions into... -
11
Factory AI
Agent-Native Software Development
...The platform integrates deeply with existing repositories and infrastructure, allowing it to analyze source code, monitor logs, and use contextual data from observability systems to make informed decisions. -
12
Stagehand
An AI web browsing framework focused on simplicity and extensibility
An AI web browsing framework focused on simplicity and extensibility. Stagehand is the AI-powered successor to Playwright, offering three simple APIs (act, extract, and observe) that provide the building blocks for natural language-driven web automation. The goal of Stagehand is to provide a lightweight, configurable framework, without overly complex abstractions, as well as modular support for different models and model providers. It's not going to order you a pizza, but it will help you... -
13
VibeSDK
Open source full-stack AI vibe coding platform & web app generator
VibeSDK is an open source “vibe coding” platform. VibeSDK is a project built by Cloudflare. It provides a full-stack reference implementation of an AI-driven system. Users describe the application they want in natural language, and the system generates, previews, and deploys the resulting web app. It uses Cloudflare’s infrastructure (Workers, Containers, sandboxes). -
14
GLM-4.7
Advanced language and coding AI model
GLM-4.7 is an advanced agent-oriented large language model designed as a high-performance coding and reasoning partner. It delivers significant gains over GLM-4.6 in multilingual agentic coding, terminal-based workflows, and real-world developer benchmarks such as SWE-bench and Terminal Bench 2.0. The model introduces stronger “thinking before acting” behavior, improving stability and accuracy in complex agent frameworks like Claude Code, Cline, and Roo Code. GLM-4.7 also advances “vibe... -
15
AnythingLLM
The all-in-one Desktop & Docker AI application with full RAG and AI
A full-stack application that enables you to turn any document, resource, or piece of content into a context that any LLM can use as references during chatting. This application allows you to pick and choose which LLM or Vector Database you want to use as well as supporting multi-user management and permissions. AnythingLLM is a full-stack application where you can use commercial off-the-shelf LLMs or popular open-source LLMs and vectorDB solutions to build a private ChatGPT with no... -
16
Agent Development Kit (ADK)
Open-source, code-first Python toolkit for building, evaluating, etc.
ADK (Android Device Key) Python is a reference implementation by Google for working with Android attestation keys in Python. It facilitates the integration of Android attestation features into backends or systems that require verification of device identity and integrity. This is especially important in high-security applications where verifying that a device is genuine and uncompromised is critical. ADK Python helps developers verify hardware-backed keys, work with JSON Web Tokens (JWT),... -
17
LaVague
Framework for building AI agents that automate complex web tasks
LaVague is an open source framework designed to help developers build AI-powered web agents capable of automating tasks across websites and web applications. It implements the concept of a Large Action Model framework, allowing agents to interpret a user-provided objective and translate it into a sequence of actions performed in a browser. These agents can navigate web pages, retrieve information, fill out forms, and execute multi-step workflows automatically. ... -
18
MLC LLM
Universal LLM Deployment Engine with ML Compilation
MLC LLM is a machine learning compiler and deployment framework designed to enable efficient execution of large language models across a wide range of hardware platforms. The project focuses on compiling models into optimized runtimes that can run natively on devices such as GPUs, mobile processors, browsers, and edge hardware. By leveraging machine learning compilation techniques, mlc-llm produces high-performance inference engines that maintain consistent APIs across platforms. The system... -
19
ChatCraft.org
Developer-oriented ChatGPT clone
Welcome to ChatCraft.org, your open-source web companion for coding with Large Language Models (LLMs). Designed with developers in mind, ChatCraft transforms the way you interact with GPT models, making it effortless to read, write, debug, and enhance your code. Whether you're exploring new designs or learning about the latest technologies, ChatCraft is your go-to platform. -
20
Spark TTS
Spark-TTS Inference Code
Spark TTS is an open-source, PyTorch-based text-to-speech inference system that leverages large language models to produce highly natural, intelligible speech from text input. It uses an efficient single-stream architecture where speech tokens are directly reconstructed from the predictions of an LLM, removing the need for external acoustic models or complex vocoders and making the generation pipeline cleaner and faster. The project supports zero-shot voice cloning, meaning it can imitate a... -
21
OpenSumi
A framework helps you quickly build Cloud or Desktop IDE products
A framework helps you quickly build Cloud or Desktop IDE products. Integrate with your coding frameworks with ease. Support the container, Electron and front-end frameworks. Also help to ship and deploy quickly. Support VS Code plugins, OpenSumi plugins and OpenSumi modules to meet various business requirements. Customize the UI design in any way you like, no matter to simply configure the built-in UI, or develop a UI template, or build your own UI through plugins. OpenSumi framework aims to... -
22
nanobot
🐈 nanobot: The Ultra-Lightweight Clawdbot / OpenClaw
nanobot is an ultra-lightweight personal AI assistant designed to deliver powerful agent capabilities without unnecessary complexity. Built in just ~4,000 lines of clean, readable code, it offers a minimalist alternative to heavyweight agent frameworks while retaining core intelligence and extensibility. nanobot is optimized for speed and efficiency, enabling fast startup times and low resource usage across environments. Its research-ready architecture makes it easy for developers to... -
23
CodexBar
Show usage stats for OpenAI Codex and Claude Code
CodexBar is a lightweight macOS utility that displays real-time usage statistics for AI coding tools such as OpenAI Codex and Claude Code directly from the system menu bar. The application is designed to give developers quick visibility into token consumption and activity without requiring them to open web dashboards or log into provider portals. Built in Swift with a native macOS interface, it integrates seamlessly into the desktop environment and emphasizes minimal overhead. The tool is... -
24
IronClaw
IronClaw is OpenClaw inspired but focused on privacy & security
IronClaw is a security-first, open-source personal AI assistant built in Rust and designed to keep your data fully under your control. It operates on the principle that your AI should work for you, not external vendors, ensuring all data is stored locally, encrypted, and never shared. The platform emphasizes transparency, offering auditable code with no hidden telemetry or data harvesting. -
25
OpenCode
The open source coding agent
OpenCode is an open-source AI coding agent designed to assist developers directly from the terminal, desktop, or IDE environments. It functions as a locally running assistant that can analyze codebases, execute development tasks, and interact with external tools while remaining highly configurable. The system is built around an agent model that can perform actions such as file manipulation, shell execution, and web access with user confirmation. Its provider-agnostic design allows developers...
