Search Results for "web crawler source code" - Page 5
Sort By:
Showing 235 open source projects for "web crawler source code"
View related business solutions-
$300 in Free Credit Towards Top Cloud ServicesStart your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
directus
Directus wraps any SQL database with a real-time GraphQL+REST API
With over 18 million downloads, Directus is the world's first Open Data Platform for instantly turning any SQL database into an API and beautiful no-code app. Power any project with a modern, open-source data platform. A modern data platform, designed for developers. Our modular codebase is 100% JavaScript, leveraging the power of Node.js and Vue.js 3 for blazing performance and easy extensibility. You remain in complete control of your new or existing database. No need to migrate to a... -
2
Tamagui
Style React fast with 100% parity on React Native
Tamagui is a cross-platform UI framework and styling system for React and React Native that enables developers to build high-performance applications with a single codebase shared across web and mobile platforms. It combines a universal style system with a powerful optimizing compiler that transforms styled components into efficient, platform-specific output, significantly improving runtime performance. The framework provides a superset of the React Native styling API, allowing developers to... -
3
Babylon.js
Open game and rendering engine packed into a JavaScript framework
Our mission is to create one of the most powerful, beautiful, and simple Web rendering engines in the world. Our passion is to make it completely open and free for everyone. We are artists, developers, creators, and dreamers and we want to make it as simple as possible to enable everyone to bring their ideas to life. With this new version of Babylon.js, we set out to make it even easier to develop with. From a ton of new tools, to improved workflows and features, new documentation and more,... -
4
Infracost VSCode Extension
See cost estimates for Terraform right in your editor
Infracost's VSCode extension shows you cost estimates for Terraform right in your editor! Prevent costly infrastructure changes before they get into production. Compare configs, instance types, regions etc: copy/paste a code block, make changes and compare them. Quick cost estimate: write a code block and get a cost estimate without having to use AWS, Azure or Google cost calculators, or read the long/complicated pricing web pages. Catch costly typos: if you accidentally type 22 instead of 2... -
Full-stack observability with actually useful AI | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
5
privacy.sexy
Open-source tool to enforce privacy & security best-practices
Enforce privacy & security best practices on Windows, macOS, and Linux, because privacy is sexy. Regularly applying your configuration with privacy.sexy is recommended, especially after each new release and major operating system updates. Each version updates scripts to enhance stability, privacy, and security. -
6
CoAI.Dev
Next Generation AI One-Stop Internationalization Solution
CoAI.Dev is an open-source “one-stop” AIGC web application that combines a modern chat-first UI with a full backend for running, managing, and monetizing multiple AI model providers from one place. It is designed to support a wide range of LLM and image-generation backends (including OpenAI-compatible endpoints), while also providing an admin dashboard for user, subscription, and pricing controls, so it can be operated as a self-hosted AI product rather than just a personal playground. ... -
7
Elastic UI Framework
Elastic UI Framework
...The primary goal of this library is to provide reusable UI components that can be used throughout Elastic's web products. As React components, they remove CSS from the process of building UIs. As a single source of truth, the framework allows our designers to make changes to our aesthetic directly in the code. -
8
gstack
Use Garry Tan's exact Claude Code setup: 15 opinionated tools
gstack is an opinionated developer toolkit that encapsulates a complete AI-assisted software development workflow by combining multiple specialized roles into a unified command-driven interface. It is designed to replicate a highly structured engineering environment where tasks such as planning, design review, quality assurance, release management, and documentation are handled through predefined commands and workflows. The system includes a set of curated tools that simulate roles like CEO,... -
9
faster_react
Full Stack web framework with React + Faster
Faster React is a full-stack web framework built on React and Faster, designed for efficient development with automatic handling of routes, frontend bundling, and server-side rendering (SSR). It is fully compatible with Deno and serverless environments like Deno Deploy. The framework automatically detects changes, reloads components, and minifies frontend code for production. With Faster React, developers can focus on building applications while the framework handles essential backend and... -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
10
Playwriter
Chrome extension to let agents control your browser
Playwriter is an open-source project that combines a Chrome extension with a CLI to allow autonomous agents to control a web browser directly using Playwright code in a stateful sandbox environment. The system enables browser automation by running Playwright commands through a persistent session managed by a background extension, allowing agents or scripts to navigate, interact with, and query browser contexts without losing state between commands. -
11
Laravel Echo
Laravel Echo library for beautiful Pusher and Ably integration
In many modern web applications, WebSockets are used to implement realtime, live-updating user interfaces. When some data is updated on the server, a message is typically sent over a WebSocket connection to be handled by the client. This provides a more robust, efficient alternative to continually polling your application for changes. To assist you in building these types of applications, Laravel makes it easy to "broadcast" your events over a WebSocket connection. Broadcasting your Laravel... -
12
Ant Design Mobile
A configurable Mobile UI
A UI component library based on Preact, React, and React Native. Provides 40+ basic components, covering all kinds of scenarios, component features rich to meet the needs of various functional Requirements. Simple enough to get started, you can load all the code at a time or only load some of the components used in the code to avoid redundancy. On the basis of not losing the features, as far as possible to ensure a single component of the smallest, best performance. Support flexible style... -
13
express-openapi-validator
Auto-validates api requests, responses, and securities using ExpressJS
Auto-validates api requests, responses, and securities using ExpressJS and an OpenAPI 3.x specification. Express-openapi-validator is an unopinionated library that integrates with new and existing API applications. express-openapi-validator lets you write code the way you want; it does not impose any coding convention or project layout. Simply, install the validator onto your express app, point it to your OpenAPI 3 specification, then define and implement routes the way you prefer. An... -
14
Quadratic
Data science spreadsheet with Python & SQL
...The grid runs entirely in the browser with no backend service. This makes our grids completely portable and very easy to share. Quadratic has Python library support built-in. Bring the latest open-source tools directly to your spreadsheet. Quickly write code and see the output in full detail. No more squinting into a tiny terminal to see your data output. -
15
Chatbox
The Ultimate AI Copilot on Your Desktop
Chatbox is a cross-platform desktop AI client designed to give you a fast, polished, and private way to work with modern language models. It runs locally on Windows, macOS, and Linux, keeping your conversations and data stored on your own device. Chatbox acts as a unified interface for popular LLMs like ChatGPT, Claude, Gemini, and local models via Ollama, making it easy to switch providers without changing tools. Built with an ergonomic UI, it’s optimized for long sessions, prompt... -
16
Big-AGI
AI suite powered by state-of-the-art models and providing advanced AI
Big-AGI is a comprehensive, open-source AI workspace built to serve as a powerful multi-model interface for developers, researchers, and professionals who want deep control over generative AI workflows and outputs. It unifies access to multiple large language models (LLMs) and AI services through a modern web UI that emphasizes efficient interaction, flexibility, and extensibility, enabling users to conduct multi-model chats, execute code, generate images, and perform voice or text-based tasks all in one place. ... -
17
next-starter
A Next.js starter template, packed with features
next-starter is a comprehensive Next.js starter template designed to accelerate project initialization. It integrates essential tools and technologies, including TypeScript, Tailwind CSS, NextAuth.js, ESLint, Stripe, and various testing utilities, providing a robust foundation for building scalable and maintainable web applications. -
18
Browser MCP
Browser MCP is a Model Context Provider (MCP) server
Browser MCP is an MCP server plus browser integration that lets AI apps automate the user’s real browser instead of launching a separate automation session. By adapting a Playwright-style approach to control the running browser profile, it reuses logged-in sessions and cookies, which reduces re-authentication friction and helps avoid some bot-detection heuristics. The server exposes structured tools for navigation, element interaction, and artifact capture (DOM, screenshots, logs), all... -
19
GitDiagram
AI tool that converts GitHub repositories into interactive diagrams
GitDiagram is an open source web application designed to help developers quickly understand the structure and architecture of GitHub repositories by automatically generating interactive diagrams. It analyzes repository metadata such as the file tree and project documentation to build a visual representation of how different components of a project relate to one another. It uses an AI-powered pipeline to interpret repository structure and transform that information into system design diagrams... -
20
Eigent
The Open Source Cowork Desktop to Unlock Your Exceptional Productivity
Eigent is an open-source cowork desktop application designed to help you build, manage, and deploy a custom AI workforce. It enables multiple specialized AI agents to collaborate in parallel, turning complex workflows into automated, end-to-end tasks. Built on the CAMEL-AI multi-agent framework, Eigent emphasizes productivity, flexibility, and transparent system design. You can run Eigent fully locally for maximum privacy and data control, or choose a cloud-connected experience for quick... -
21
Anthropic SDK TypeScript
Access to Anthropic's safety-first language model APIs
anthropic-sdk-typescript is the TypeScript / JavaScript client library for the Anthropic REST API, enabling backend or Node.js usage of models like Claude. It wraps API endpoints for creating messages, streaming responses, and managing parameters in a type-safe TS environment. The library is designed for server-side use, interfacing with REST, and is stable for integration in web services or backend agents. Example usage shows how to instantiate the Anthropic client, call... -
22
NativeScript
Open source framework for building truly native mobile apps
...Want to code your way? NativeScript provides rich support, modern JavaScript, TypeScript, CSS, Flexbox and other web skills. Build your mobile apps free from the performance and user experience constraints of hybrid WebView-based apps. Compatible with Angular, Vue, Svelte, React, etc. -
23
Open SaaS
Open source SaaS boilerplate for React, NodeJS apps with Wasp stack
Open SaaS is a free and open source starter template designed to help developers quickly build and launch Software-as-a-Service applications. It is built on the Wasp full stack framework, which combines React, NodeJS, and Prisma to manage both client and server code within a unified architecture. Open SaaS provides a production-ready foundation that includes common SaaS functionality such as authentication, payments, analytics, and file uploads. -
24
Routr
The future of programmable SIP servers
Lightweight sip proxy, location server, and registrar that provides a reliable and scalable SIP infrastructure for telephony carriers, communication service providers, and integrators. Routr provides all the tools required to deploy your VoIP network, including a command-line for remote server control. It can also be controlled via a RESTful API or a web-based GUI. Routr includes all tools for deploying your VoIP network. It offers remote server control via command-line, RESTful API, or a... -
25
Visual Blocks
Visual Blocks for ML is a Google visual programming framework
Visual Blocks is a node-based, in-browser environment for building AI and data-processing workflows with drag-and-drop components. It lets you connect sources, transforms, models, and visualizers into a live graph, so changes propagate instantly and results are observable without writing glue code. Under the hood it leans on web-friendly runtimes (e.g., WebGPU/WebGL/WebNN or TensorFlow.js backends) to execute pipelines locally, which is great for demos, teaching, and privacy-sensitive...
