Search Results for "web crawler source code"
Sort By:
Showing 36 open source projects for "web crawler source code"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
Every Code
Local AI coding agent CLI with multi-agent orchestration tools
Every Code (often referred to simply as Code) is a fast, local AI-powered coding agent designed to run directly in the terminal environment. It is a community-driven fork of the Codex CLI, with a strong emphasis on improving real-world developer ergonomics and workflows. Every Code enhances the traditional coding assistant model by introducing multi-agent orchestration, allowing multiple AI agents to collaborate, compare solutions, and refine outputs in parallel. It supports integration with... -
2
Bot Framework Web Chat
A highly-customizable web-based client for Azure Bot Services
This repository contains code for the Bot Framework Web Chat component. The Bot Framework Web Chat component is a highly-customizable web-based client for the Bot Framework V4 SDK. The Bot Framework SDK v4 enables developers to model conversation and build sophisticated bot applications. This repo is part of the Microsoft Bot Framework, a comprehensive framework for building enterprise-grade conversational AI experiences. -
3
Claude-Mem
Claude Code plugin that automatically captures everything Claude does
Claude-Mem is a persistent memory compression system built specifically for Claude Code to preserve context across coding sessions. It automatically captures Claude’s tool usage, observations, and decisions, then compresses them into semantic memories that carry forward into future sessions. By enabling long-term continuity, Claude-Mem helps Claude “remember” project history, past fixes, and prior reasoning even after restarts or reconnects. Its progressive disclosure approach intelligently... -
4
AnythingLLM
The all-in-one Desktop & Docker AI application with full RAG and AI
A full-stack application that enables you to turn any document, resource, or piece of content into a context that any LLM can use as references during chatting. This application allows you to pick and choose which LLM or Vector Database you want to use as well as supporting multi-user management and permissions. AnythingLLM is a full-stack application where you can use commercial off-the-shelf LLMs or popular open-source LLMs and vectorDB solutions to build a private ChatGPT with no... -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
Search with Lepton
Lightweight demo to build a conversational AI search engine quickly
Search with Lepton is an open source demonstration project that shows how to build a conversational search engine using the Lepton AI framework. It combines traditional web search with large language models to provide natural language answers to user queries. It retrieves information from supported search engines and uses that context to generate responses through a retrieval-augmented generation approach. -
6
ego (lite)
The fastest browser for AI agents to run web automation
Ego Lite is a macOS browser designed for people and external AI agents to work in parallel. Each agent receives an isolated Space, allowing several browser tasks to run simultaneously without taking over the user's active tabs. Optional Chrome data migration carries over logins, cookies, extensions, and bookmarks so agents can use authenticated sessions with less setup. The ego-browser skill connects tools such as Codex, Claude Code, Cursor, and custom agent CLIs to the browser. Agents... -
7
Cofounder
AI tool that generates full-stack web apps with generative UI systems
Cofounder is an experimental open source development tool designed to generate complete full-stack web applications using AI-assisted workflows. It focuses on creating applications that include a backend, database integration, and stateful web interfaces while also generating user interfaces through a generative UI system rooted in application architecture. Developers can describe a project and allow the system to incrementally produce a working codebase that includes both backend services and a modern web frontend built with a Vite and React setup. ... -
8
Groq Desktop
Local Groq Desktop chat app with MCP support
Groq Desktop is a cross-platform (Windows / macOS / Linux) local desktop application that provides a graphical chat interface for interacting with Groq-hosted, function-call-capable models. It bundles a built-in MCP (Model Context Protocol) server enabling smart function calling, letting users chat with an AI, send images, or interact with richer multimodal inputs — all from a friendly desktop UI. The app is built with modern web technologies and packaged for native distribution, making it... -
9
AstronRPA
Agent-ready RPA suite with visual workflow automation tools engine
Astron RPA is an enterprise-grade robotic process automation platform designed to help organizations and developers build automated workflows for desktop and web applications. It provides a visual workflow designer that supports low-code and no-code development, allowing users to create automation processes through a drag-and-drop interface instead of writing extensive code. It enables automation of common desktop software and browser-based tasks, making it suitable for repetitive business... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
GitDiagram
AI tool that converts GitHub repositories into interactive diagrams
GitDiagram is an open source web application designed to help developers quickly understand the structure and architecture of GitHub repositories by automatically generating interactive diagrams. It analyzes repository metadata such as the file tree and project documentation to build a visual representation of how different components of a project relate to one another. It uses an AI-powered pipeline to interpret repository structure and transform that information into system design diagrams... -
11
Open SaaS
Open source SaaS boilerplate for React, NodeJS apps with Wasp stack
Open SaaS is a free and open source starter template designed to help developers quickly build and launch Software-as-a-Service applications. It is built on the Wasp full stack framework, which combines React, NodeJS, and Prisma to manage both client and server code within a unified architecture. Open SaaS provides a production-ready foundation that includes common SaaS functionality such as authentication, payments, analytics, and file uploads. -
12
Antigravity Claude Proxy
Proxy that exposes Antigravity provided claude / gemini models
Antigravity Claude Proxy is a purpose-built proxy server that enables developers to interface with Claude models through a standardized RESTful API, allowing tools and workflows that expect generic HTTP APIs to operate on Anthropic’s Claude without native support. The project acts as a translation layer, receiving web requests in common formats (such as OpenAI-style endpoints) and forwarding them to Anthropic’s API in the required structure, while converting responses back into a familiar... -
13
Jimp
An image processing library written entirely in JavaScript for Node
An image processing library for Node written entirely in JavaScript, with zero native dependencies. If you're using this library with TypeScript the method of importing slightly differs from JavaScript. Instead of using require, you must import it with ES6 default import scheme. If you're using a web bundles (webpack, rollup, parcel) you can benefit from using the module build of jimp. Using the module build will allow your bundler to understand your code better and exclude things you aren't... -
14
Context Hub
Makes coding agents get smarter with every task
Context Hub is a curated documentation system built to help coding agents write more accurate code. It gives agents versioned, language-specific reference material instead of forcing them to rely on noisy web searches or stale model memory. The project includes a CLI called chub that agents can use to search for available docs, fetch specific API guidance, and request only the files they need. It also supports local annotations, allowing an agent to remember project-specific notes, pitfalls, or workarounds across future sessions. ... -
15
Klavis AI
MCP integration platforms for AI agents to use tools at any scale
Klavis AI is a Y Combinator X25-backed open-source infrastructure platform that enables AI agents to reliably connect with external tools and services at scale through Model Context Protocol (MCP). Founded by ex-Google DeepMind and ex-Lyft engineers, Klavis provides 50+ production-ready MCP servers with enterprise OAuth support for GitHub, Slack, Gmail, Salesforce, Linear, Notion, and more. The flagship product Strata solves tool overload through progressive discovery, achieving +13% higher... -
16
LaVague
Framework for building AI agents that automate complex web tasks
LaVague is an open source framework designed to help developers build AI-powered web agents capable of automating tasks across websites and web applications. It implements the concept of a Large Action Model framework, allowing agents to interpret a user-provided objective and translate it into a sequence of actions performed in a browser. These agents can navigate web pages, retrieve information, fill out forms, and execute multi-step workflows automatically. ... -
17
dashAI
dashAI: an interactive platform for training, evaluating and deploying
dashAI is an open-source, No-code workbench for Exploratory Data Analysis and classical ML. Visual data preparation, multi-model experiments, XAI explainability, and a plugin-based extensible catalog. The platform guides users through a complete, traceable workflow — data ingestion → visual exploration → preprocessing → model training → evaluation → explainability — without writing a single line of code. Each step is explicit and reversible, keeping the user in control rather than... -
18
Flow Teleprompter
A Windows first teleprompter with voice tracking and AI drafting.
Flow is an ultra-lightweight, high-performance desktop teleprompter built with Tauri and Rust. It is designed for creators & presenters who need a clean reading surface without sacrificing advanced features like native voice tracking via local Vosk models and app-wide voice commands. It features five playback styles (highlight, scroll, line, arrow, and voice tracking), local-first privacy, and a built-in script editor. Version 1.9.0 introduces WebRTC-powered real-time collaborative... -
19
Mermaid.js to SVG Converter
Visualize the diagrams of your projects
...The trick is to ask the AI to write a diagram in Mermaid.js format that solidifies the structure of the project and then use that as context to keep the AI reminded at all times what the project is as a whole. This will prevent it from changing things its not supposed to change. This standalone offline web app will convert that mermaid.js code into a visual SVG image so that YOU as a human will be able to understand what the AI think about the structure of your projects so you can see it and fix any misconceptions until the diagram is correct for your project. (Source code is included in the html itself. Open it in a web browser to use.) -
20
OpenSparrow
Advanced Data Management Platform | PHP + vanilla JS + Postgres!
OpenSparrow is a professional PHP + PostgreSQL platform with a vanilla JS frontend. It transforms JSON structures into powerful business apps with user permissions. Advanced Data Grid Inline editing, error validation, status coloring, global search, and CSV export. Nested Relations Support for "Drilldown" views to display nested data and sub-tables inside a record view. Visual Admin Panel Configure schemas, form layouts, columns, and relations via GUI without writing... -
21
Basaran
Basaran, an open-source alternative to the OpenAI text completion API
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models. The open source community will eventually witness the Stable Diffusion moment for large language models (LLMs), and Basaran allows you to replace OpenAI's service with the latest open-source model to power your application without modifying a single line of code. -
22
ChatLLM Web
Chat with LLM like Vicuna totally in your browser with WebGPU
Chat with LLM like Vicuna totally in your browser with WebGPU, safely, privately, and with no server. Powered By web-llm. To use this app, you need a browser that supports WebGPU, such as Chrome 113 or Chrome Canary. Chrome versions ≤ 112 are not supported. You will need a GPU with about 6.4GB of memory. If your GPU has less memory, the app will still run, but the response time will be slower. The first time you use the app, you will need to download the model. For the Vicuna-7b model that... -
23
OpenAI Web Application
A web application that allows users to interact with OpenAI's models
A web application that allows users to interact with OpenAI's modles through a simple and user-friendly interface. This app is for demo purpose to test OpenAI API and may contain issues/bugs. User-friendly interface for making requests to the OpenAI API. Responses are displayed in a chat-like format. Select Models (Davinci, Codex, DALL·E, Whisper) based on your needs. Create AI Images (DALL·E). Audio-Text Transcribe (Whisper). Highlight code syntax. Type in the input field and press enter or... -
24
e-Dokyumento
e-Dokyumento is web-based Document Management System (DMS)
e-Dokyumento is opensource web-based Document Management System (DMS) A Document Management which automates the basic office document workflow such as receiving, filing, routing, and approving through capturing (scanning), digitizing (OCR Reading), storing, tagging, and electronically routing and approving (e-signature) of electronic documents. # Demo : https://e-dokyumento.herokuapp.com/ https://edokyu.seillig.com/ (refer to Readme.md for the... -
25
DreamTime
Use artificial intelligence to create images
The easiest-to-use application to create fake images from photos and videos. Available for Windows, Linux, and Mac. By being open-source you can build a version for your operating system. Source code is available and totally free, without premium versions or cracks. More stable than DeepNude and easy to use thanks to its modern design. Create the body of your dreams, increase or decrease the size of the body parts or leave everything to random. Don't just stay with static photos, you can also create GIFs, MP4 and WEBM videos! ...
