Search Results for "web crawler source code" - Page 4
Sort By:
Showing 235 open source projects for "web crawler source code"
View related business solutions-
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
1
Boilerplate and Starter for Next JS 12+
Boilerplate and Starter for Next.js 12+, Tailwind CSS 3 and TypeScript
Boilerplate and Starter for Next JS 12+, Tailwind CSS 3 and TypeScript. Boilerplate and Starter for Next.js, Tailwind CSS and TypeScript. Made with developer experience first: Next.js, TypeScript, ESLint, Prettier, Husky, Lint-Staged, Jest, Testing Library, Commitlint, VSCode, Netlify, PostCSS, Tailwind CSS. If you are VSCode users, you can have a better integration with VSCode by installing the suggested extension in .vscode/extension.json. The starter code comes up with Settings for a... -
2
tRPC
End-to-end typesafe APIs made easy
tRPC allows you to easily build & consume fully typesafe APIs, without schemas or code generation. As TypeScript and static typing increasingly become a best practice in web programming, the API presents a major pain point. We need better ways to statically type our API endpoints and share those types between our client and server (or server-to-server). We set out to build a simple library for building typesafe APIs that leverage the full power of modern TypeScript. Introducing RPC!... -
3
SurveyJS
JavaScript Survey and Form Library
SurveyJS Form Library is distributed as npm packages and as scripts and style sheets that you can reference on your page. You can use it in any React, Angular, Vue, Knockout, or jQuery application. React, Angular, Knockout, and Vue3 are supported natively. To communicate with the server, the libraries use JSON objects that represent form schemas (content and layout of a form) and form results (answers). You have the option to build dynamic JSON-driven forms using our free full-featured... -
4
Search with Lepton
Lightweight demo to build a conversational AI search engine quickly
Search with Lepton is an open source demonstration project that shows how to build a conversational search engine using the Lepton AI framework. It combines traditional web search with large language models to provide natural language answers to user queries. It retrieves information from supported search engines and uses that context to generate responses through a retrieval-augmented generation approach. -
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
5
Foam
A personal knowledge management and sharing system for VSCode
Foam is a personal knowledge management and sharing system inspired by Roam Research, built on Visual Studio Code and GitHub. You can use Foam for organizing your research, keeping re-discoverable notes, writing long-form content and, optionally, publishing it to the web. Foam is free, open source, and extremely extensible to suit your personal workflow. You own the information you create with Foam, and you're free to share it and collaborate on it with anyone you want. -
6
React Hook Form
React Hooks for form state management and validation
Performant, flexible, and extensible forms with easy-to-use validation. Intuitive, feature-complete API providing a seamless experience to developers when building forms. Leverage existing HTML markup and validate your forms with our constraint-based validation API. Package size matters. React Hook Form is a tiny library without any dependencies. Minimizes the number of re-renders, minimizes validate computation, and faster mounting. Since the form state is inherently local, it can be easily... -
7
TypeScript Express Starter
Quick and Easy TypeScript Express Starter
Express consists of JavaScript, which makes it vulnerable to type definitions. That's why we avoid supersets with starter packages that introduce TypeScript. The package is configured to use TypeScript instead of JavaScript. Express is a fast, open and concise web framework and is a Node.js based project. npx is a tool in the JavaScript package management module, npm. This is a tool that allows you to run the npm package on a single run without installing the package. If you do not enter a... -
8
FlareSolverr
Proxy server to bypass Cloudflare protection
FlareSolverr is a proxy server to bypass Cloudflare and DDoS-GUARD protection. FlareSolverr starts a proxy server, and it waits for user requests in an idle state using few resources. When some request arrives, it uses puppeteer with the stealth plugin to create a headless browser (Firefox). It opens the URL with user parameters and waits until the Cloudflare challenge is solved (or timeout). The HTML code and the cookies are sent back to the user, and those cookies can be used to bypass... -
9
webR
The statistical language R compiled to WebAssembly via Emscripten
webR is a project that compiles the R statistical programming language into WebAssembly, enabling it to run entirely within web browsers or JavaScript environments without requiring a server-side installation. By using Emscripten to adapt R’s C, C++, and Fortran codebase, webR creates a fully functional runtime that can execute R scripts directly in the browser. The project includes a web-based integrated development environment that uses tools like xterm.js and CodeMirror, allowing users to... -
Gemini 3 and 200+ AI Models on One PlatformBuild generative AI apps with Vertex AI. Switch between models without switching platforms.
-
10
Feynman
The open source AI research agent
Feynman is a command-line AI research agent designed to automate complex research workflows by orchestrating multiple specialized agents that collaborate to gather, analyze, and synthesize information into structured outputs. It operates as a “Claude Code for research,” allowing users to input natural language queries and receive fully developed, source-grounded research briefs, literature reviews, or experimental analyses. The system is built around a multi-agent architecture that includes... -
11
crawlee
A web scraping and browser automation library for Node.js
Crawlee is a web scraping and browser automation library. It helps you build reliable crawlers. Fast. Crawlee won't fix broken selectors for you (yet), but it helps you build and maintain your crawlers faster. When a website adds JavaScript rendering, you don't have to rewrite everything, only switch to one of the browser crawlers. When you later find a great API to speed up your crawls, flip the switch back. It keeps your proxies healthy by rotating them smartly with good fingerprints that... -
12
Mini QR
Create & scan cute qr codes easily
Mini QR is a web app focused on making QR codes feel friendly and design-forward, combining a polished QR generator with a built-in scanner so you can both create and decode codes in the same place. It emphasizes customization so the QR you generate can match a brand, event theme, or personal style, including color and styling controls, framed layouts with labels, and the ability to add a logo image. Because QR reliability matters as much as looks, it exposes practical settings like error... -
13
ChatGPT Exporter
Export and Share your ChatGPT conversation history
ChatGPT Exporter is a browser-based userscript tool designed to export ChatGPT conversations into multiple structured and shareable formats, enabling users to preserve, analyze, and reuse AI-generated content outside the ChatGPT interface. It integrates directly into the ChatGPT web environment, typically via tools like Tampermonkey, and adds export functionality without requiring backend services or complex setup. The tool supports a wide range of output formats including plain text, HTML,... -
14
Remotion
Make videos programmatically with React
Remotion is a cutting-edge library that lets developers create real videos programmatically using React components, transforming familiar UI paradigms into a flexible, code-driven video production workflow. Instead of traditional timeline editors, Remotion leverages HTML, CSS, and JavaScript to define video frames, animations, and transitions, which means developers can use states, props, loops, and component hierarchies to automate complex motion graphics. Because it integrates with the... -
15
GraphQL
The GraphQL LSP reference ecosystem for building browser & IDE tools
GraphiQL is the reference implementation of this monorepo, GraphQL IDE, an official project under the GraphQL Foundation. The code uses the permissive MIT license. Whether you want a simple GraphiQL IDE instance for your server, or a more advanced web or desktop GraphQL IDE experience for your framework or plugin, or you want to build an IDE extension or plugin, you've come to the right place! GraphiQL provides monaco editor with a powerful, schema-driven graphql language mode. It also... -
16
DeepChat
A smart assistant that connects powerful AI to your personal world
DeepChat is an open‑source, multi‑model AI chat platform featuring a unified interface for cloud and local language models, enriched with tool‑calling capabilities, search enhancements, privacy protection, and extensive model support. DeepChat is a powerful open-source AI chat platform providing a unified interface for interacting with various large language models. Whether you're using cloud APIs like OpenAI, Gemini, Anthropic, or locally deployed Ollama models, DeepChat delivers a smooth... -
17
COBE
5KB WebGL globe lib
The COBE project is a lightweight WebGL-based library for rendering interactive 3D globes in web applications. It is designed to provide visually appealing globe visualizations with minimal setup and high performance. The library focuses on simplicity, allowing developers to create animated and interactive globe experiences with just a few lines of code. It supports smooth animations, rotation, and customizable visual styles, making it suitable for dashboards, landing pages, and data... -
18
xplat
Cross-platform (xplat) tools for Nx workspaces.
xplat is a cross-platform development toolkit by nstudio that extends the capabilities of the Nx workspace. It enables developers to build applications targeting multiple platforms, including web, mobile, and desktop, using a single codebase. -
19
Suna
Suna - Open Source Generalist AI Agent
Suna is an open-source generalist AI agent developed by Kortix AI. Designed to assist users in accomplishing real-world tasks through natural conversation, Suna combines powerful capabilities with an intuitive interface. It serves as a digital companion for research, data analysis, and everyday challenges, integrating tools like browser automation, file management, web crawling, command-line execution, website deployment, and API integration. Suna's architecture comprises a FastAPI-based... -
20
Stlite
n-browser Streamlit
Stlite is a WebAssembly-powered framework that enables Streamlit applications to run entirely in the browser without requiring a Python backend server. It achieves this by using Pyodide, a WebAssembly-based Python runtime, to execute Python code directly within the browser environment. This allows developers to build interactive data applications using familiar Streamlit APIs while eliminating the need for server-side infrastructure. Stlite supports a wide range of Python libraries and... -
21
OpenHands
Open-source autonomous AI software engineer
...So we're building all our agents in the open on GitHub, under the MIT license. Our agents can do anything a human developer can: they write code, run commands, and use the web. We're partnering with AI safety experts like Invariant Labs to balance innovation with security. -
22
Dev Browser
A Claude Skill to give your agent the ability to use a web browser
Dev Browser is a browser automation skill/plugin that enables an AI agent to control a real browser for verification and testing during development. Its purpose is to close the gap between “code was written” and “the UI actually works,” by letting the agent navigate, interact with pages, and validate behavior in a live environment. A key idea is persistence: the browser can keep pages open so the agent can navigate once and then perform multiple interactions across scripts without losing... -
23
directus
Directus wraps any SQL database with a real-time GraphQL+REST API
With over 18 million downloads, Directus is the world's first Open Data Platform for instantly turning any SQL database into an API and beautiful no-code app. Power any project with a modern, open-source data platform. A modern data platform, designed for developers. Our modular codebase is 100% JavaScript, leveraging the power of Node.js and Vue.js 3 for blazing performance and easy extensibility. You remain in complete control of your new or existing database. No need to migrate to a... -
24
Fulling
Full-stack Engineer Agent. Built with Next.js, Claude, shadcn/ui
...It integrates an AI pair programmer that can generate code, implement features, and assist with debugging tasks through natural language instructions. The environment also includes web-based terminals, file management tools, and version control capabilities to support collaborative software development workflows. Developers can connect external services by simply providing API credentials, allowing the AI system to automatically integrate features such as authentication or payment processing. -
25
MemFree
Hybrid AI Search Engine & AI Page Generator
memfree is an open source hybrid AI search engine and page generation platform designed to help users retrieve information from both personal knowledge bases and the public web through a unified interface. The project combines retrieval-augmented search with AI summarization to deliver concise answers instead of forcing users to manually sift through multiple sources.
