Search Results for "pages"
Sort By:
543 projects for "pages" with 2 filters applied:
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
Spider
High-performance Rust web crawler and scraper for large-scale data
Spider is a high-performance web crawler and web scraping library written in Rust that enables developers to crawl and index websites efficiently. It focuses on speed, concurrency, and reliability by using asynchronous and multi-threaded processing to handle large volumes of web pages. It can rapidly crawl websites to collect links, retrieve page content, and extract structured information from HTML documents. Spider can operate concurrently across many pages, allowing it to gather large datasets in a short period of time. Spider also provides mechanisms for subscribing to crawl events so developers can process page data such as URLs, status codes, or HTML content as it is discovered. ... -
2
single-file-cli
CLI tool to save complete web pages as single self-contained HTML file
SingleFile CLI is an open source command-line tool designed to save complete web pages as a single self-contained HTML file. It captures the rendered page in a headless browser and embeds all required resources directly into the output document, including stylesheets, scripts, images, and fonts. By consolidating every dependency into one file, it allows users to preserve a faithful copy of a web page that can be viewed offline without requiring external assets. -
3
goclone
Fast CLI tool for cloning entire websites for local browsing offline
goclone is a command-line utility designed to download and mirror complete websites to a local directory for offline access. It retrieves HTML pages, stylesheets, JavaScript files, images, and other assets from a target site and stores them on the user’s computer. It preserves the original site’s structure by maintaining relative links between pages, allowing the mirrored copy to function similarly to the live version when opened locally. Once a site has been cloned, users can browse the pages offline and navigate between them as if they were viewing the site online. goclone is written in Go and leverages concurrency through Go routines to perform downloads efficiently. goclone can also optionally start a local web server to serve the mirrored files for a more realistic browsing experience. ... -
4
Toapi
Convert websites into structured APIs automatically with Python tool
...Instead of building a traditional web crawler that collects and stores data before exposing it through an API, Toapi simplifies the process by allowing developers to define data structures that automatically generate an API layer from existing web pages. It works by parsing HTML content from a source site and mapping selected elements into structured data that can be returned as JSON through API endpoints. Developers define items and routes that determine how web pages are parsed and how the resulting data is exposed through the API interface. It also includes mechanisms for caching both page content and API requests, helping reduce repeated network calls and improving performance. ... -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
Dev Browser
A Claude Skill to give your agent the ability to use a web browser
Dev Browser is a browser automation skill/plugin that enables an AI agent to control a real browser for verification and testing during development. Its purpose is to close the gap between “code was written” and “the UI actually works,” by letting the agent navigate, interact with pages, and validate behavior in a live environment. A key idea is persistence: the browser can keep pages open so the agent can navigate once and then perform multiple interactions across scripts without losing state each time. It supports flexible execution modes, allowing full-script runs when tasks are straightforward and step-by-step exploration when the agent needs to inspect or iterate carefully. ... -
6
Zeus Panel
Cloudflare Zeus Panel (Zeus Panel) https://t.me/ZEUS_PANEL_BOT
...Administrators can control users by traffic volume, time, request count, bandwidth, and simultaneous devices. The system supports automatic quota resets, bulk account operations, subscription links, QR codes, and individual status pages. Network tools include clean IP discovery and rotation, custom proxies, live Cloudflare request monitoring, fragments, and fingerprint simulation. DNS controls can block advertising and adult domains, while JSON export and import provide backup and recovery. The responsive Tailwind interface includes dark mode, mobile support, automatic core updates, and management of multiple Cloudflare accounts. -
7
Bili23 Downloader
Cross platform GUI tool for downloading videos from Bilibili sites
...It supports high performance downloads through multi-threading and includes resume capabilities so interrupted downloads can continue without starting over. It can parse different types of links such as standard video pages, short links, and collection or activity pages to automatically retrieve downloadable media. It also allows users to choose video resolution, audio quality, and encoding format based on the available sources. Additional features include downloading subtitles, comments, metadata, and artwork associated with videos. -
8
Pirate Bay Proxy List 2026
Working The Pirate Bay proxy list 2026
...The project emphasizes regular updates and verification, making freshness its main practical feature. It is mostly HTML-based and oriented toward easy browsing through a published GitHub Pages-style site. Because the links relate to torrent access, users must evaluate legality, safety, and copyright compliance in their own location before using any listed resource. From a software perspective, the repository is best described as a curated, static web directory. -
9
geo-seo-claude
GEO-first SEO skill for Claude Code
...It leverages AI to generate location-specific content tailored to different regions, allowing users to scale SEO efforts across multiple cities or markets without manual content creation. The system focuses on producing structured and keyword-optimized pages that align with search engine ranking factors, including localized relevance and semantic context. It is particularly useful for agencies, marketers, and businesses that need to manage large volumes of localized landing pages efficiently. Geo SEO Claude can integrate with existing content pipelines, enabling automated generation and deployment of SEO assets. ... -
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
10
wombat
Lightweight Ruby DSL for scraping structured data from web pages
...The DSL approach helps make scraping definitions more readable and maintainable, especially when dealing with multiple fields or nested data structures. Because it is implemented as a Ruby library, it integrates easily into Ruby applications and scripts that need to gather information from web pages. Wombat also includes examples and tests that demonstrate how scraping definitions can be written and executed within Ruby environments. -
11
videodl
Lightweight Python tool for downloading videos from many platforms
Videodl is a lightweight video downloader implemented entirely in Python that allows users to retrieve videos from a wide range of online media platforms. It focuses on providing a fast and simple way to parse video pages and download media files, often prioritizing high-definition versions without watermarks when available. It supports numerous video platforms across both Chinese and international streaming ecosystems, enabling users to fetch content from many popular services through a unified interface. Videodl works by implementing platform-specific client modules that extract video information and download links from supported services. ... -
12
Mink
PHP web browser emulator abstraction
...Mink is commonly used in behavior-driven development workflows, particularly with frameworks like Behat, where it helps simulate real user behavior such as clicking links, filling forms, and navigating pages. The library supports session management, allowing multiple browser sessions to run simultaneously and interact with different pages or environments. -
13
newspaper4k
Python library for scraping and analyzing online news articles easily
...It is a continuation and active fork of the original newspaper3k library, which had stopped receiving updates, with the goal of keeping the ecosystem maintained while adding improvements and bug fixes. It provides developers with tools to automatically download web pages, extract the main article content, and collect associated metadata such as titles, authors, images, and publication dates. Newspaper4k also includes natural language processing capabilities that can generate summaries and identify keywords from extracted article text. Newspaper4k supports both single-article extraction and full news site processing, allowing users to build sources representing entire publications and iterate through their articles. ... -
14
QueryList
Progressive PHP web crawler framework with jQuery-like DOM parsing
QueryList is an extensible PHP web scraping and crawling framework designed to extract and process data from web pages. It provides a simple and expressive API that allows developers to collect structured information from HTML documents using familiar DOM traversal techniques. It is built on top of phpQuery and uses CSS3 selectors similar to those found in jQuery, making it easy for developers to query and manipulate page elements during scraping tasks. -
15
Linkwarden
Self-hosted collaborative bookmark manager
Linkwarden is a self-hosted, open-source bookmark manager built to help individuals and teams collect, organize, and preserve important web content in a way that stays useful long after the original pages change or disappear. Instead of saving only a URL, it captures durable archived formats so your saved knowledge remains accessible even when link rot happens. The experience is designed to feel like a modern “read-it-later” tool, with a reader view that makes long articles easier to consume and built-in highlighting and annotations so you can keep context on why a link mattered. ... -
16
skycaiji
Open source web scraping system for automated data collection tasks
SkyCaiji is an open source web scraping and data collection system designed to gather information from websites through configurable extraction rules. It focuses on simplifying the process of building crawlers by allowing users to visually define scraping rules rather than writing complex code. It can collect structured or unstructured data from many types of webpages and automate the extraction process for large datasets. SkyCaiji is designed to run on a variety of hosting environments... -
17
Vimium
The hacker's browser
Vimium is a browser extension that brings Vim-style keyboard control to everyday web browsing. It lets users scroll, open links, move through history, manage tabs, search pages, and navigate bookmarks without relying on the mouse. The project is aimed at power users who want faster, more keyboard-centered interaction with Chrome, Edge, or Firefox. It includes a large set of default shortcuts inspired by the Vim editor, while still allowing users to remap or remove commands through custom key mappings. Vimium also supports link hints, tab search, marks, visual mode, URL editing, page source viewing, and repeated commands. ... -
18
SkyCrypt
A Hypixel skyblock stats website
SkyCrypt is a web-based application that allows players of Hypixel SkyBlock to view and share detailed information about their in-game profiles through a visually rich interface. It aggregates data from the Hypixel API and presents it in an organized format, including player statistics, skills, equipment, and inventory details. The project is built with a Node.js-based stack and integrates additional technologies such as MongoDB and Redis to handle data storage and caching. SkyCrypt enhances... -
19
douyin
Open source Douyin crawler for collecting and downloading public data
...It demonstrates how to build a Python-based web crawler combined with a graphical interface and command line functionality. It allows users to collect data from various types of Douyin content, including user profiles, videos, hashtags, and music pages. DouyinCrawler supports both automated scraping and batch operations to process multiple targets efficiently. It also integrates with the Aria2 download utility to enable large-scale downloading of videos and images associated with collected content. It includes multiple usage modes such as a desktop GUI, a web service interface, and a command line tool for flexible deployment. ... -
20
Pinchtab
High-performance browser automation bridge and orchestrator
Pinchtab is a lightweight browser automation backend built specifically for AI agents that need efficient, programmatic web control. Implemented as a small standalone HTTP server, it allows any agent or script to interact with web pages using simple API calls instead of heavyweight browser frameworks. The tool emphasizes accessibility-first snapshots that dramatically reduce token usage compared to screenshot-based approaches, making it cost-effective for large-scale automation. It launches and manages its own Chrome instance while remaining framework-agnostic, so it can be used with any language or agent system. ... -
21
Rhit
A nginx log explorer
...It reads standard log files from their usual locations and can process compressed logs without requiring a separate database. Results are summarized in compact console tables rather than stored in another analytics system. Users can filter requests by dates, HTTP status codes, referring pages, and request paths. Trend analysis helps reveal how traffic patterns change across a selected time period. Its performance is designed for interactive investigation, allowing repeated queries against millions of log lines. Rhit is useful for administrators who want quick traffic insights without installing a larger observability stack. -
22
X4G
Fast and modern gateway for VLESS tunneling on WebSocket and XHTTP
...Administrators can create unlimited connection links with individual traffic quotas, bandwidth limits, expiration dates, ports, and simultaneous IP restrictions. Subscription groups combine multiple configurations into shareable public pages that can be protected with passwords and exported as QR codes. Persistent storage preserves configurations and usage data across deployments, while an optional Telegram bot provides remote management without opening the web panel. -
23
Browserless
The headless Chrome/Chromium driver on top of Puppeteer
...The project is designed to act as a production-ready abstraction layer over Puppeteer, offering improved reliability, error handling, and scalability for real-world applications. Browserless includes built-in optimizations such as request blocking, automatic retries, and sensible defaults that improve performance when processing web pages. It can be used as a standalone library, a command-line tool, or a hosted API service that scales browser instances on demand. -
24
autocrawler
Multiprocess Selenium crawler for downloading images by keywords
AutoCrawler is a Python-based image crawling tool designed to automatically download large numbers of images from search engines using automated browser interaction. It uses Selenium and a Chrome browser driver to navigate image search pages and collect image sources based on keywords provided by the user. AutoCrawler supports multiprocess and multithreaded downloading, which allows it to retrieve images faster by running several tasks simultaneously. Users provide search terms through a simple keyword file, and the crawler organizes downloaded images into directories for each keyword. ... -
25
FEAPDER
Powerful Python crawler framework for scalable web scraping tasks
...It also integrates monitoring and alerting capabilities to help developers track crawler performance and detect issues during execution. feapder includes browser rendering support for handling dynamic web pages and provides mechanisms for large-scale data deduplication during crawling.
