Search Results for "pages"
Sort By:
Showing 21 open source projects for "pages"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
single-file-cli
CLI tool to save complete web pages as single self-contained HTML file
SingleFile CLI is an open source command-line tool designed to save complete web pages as a single self-contained HTML file. It captures the rendered page in a headless browser and embeds all required resources directly into the output document, including stylesheets, scripts, images, and fonts. By consolidating every dependency into one file, it allows users to preserve a faithful copy of a web page that can be viewed offline without requiring external assets. -
2
kimuraframework
AI-first Ruby framework for building fast, flexible web scraping spide
...It provides a clean domain-specific language that allows developers to define scraping logic and data schemas with minimal boilerplate code. Kimurai can use AI-assisted extraction to identify where data resides in HTML pages, automatically generating selectors that are cached for future use so subsequent scraping runs operate with pure Ruby performance. Kimurai supports scraping both static and JavaScript-rendered websites by working with multiple engines, including headless browsers and simple HTTP-based approaches. Developers can also interact with pages using browser automation features such as form filling, clicking elements, or navigating through dynamic content. ... -
3
Seeker
Accurately Locate Smartphones using Social Engineering
Seeker is an open source project that demonstrates how to obtain precise location information from devices using social engineering and web-based techniques. The tool sets up a phishing page that asks for location permissions, allowing GPS and other device data to be shared if the user consents. It can capture latitude, longitude, accuracy, altitude, direction, and even speed, with results displayed in a terminal. The project supports both manual deployment and tunneling services like Ngrok... -
4
newspaper4k
Python library for scraping and analyzing online news articles easily
...It is a continuation and active fork of the original newspaper3k library, which had stopped receiving updates, with the goal of keeping the ecosystem maintained while adding improvements and bug fixes. It provides developers with tools to automatically download web pages, extract the main article content, and collect associated metadata such as titles, authors, images, and publication dates. Newspaper4k also includes natural language processing capabilities that can generate summaries and identify keywords from extracted article text. Newspaper4k supports both single-article extraction and full news site processing, allowing users to build sources representing entire publications and iterate through their articles. ... -
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
5
watercrawl
AI-ready web crawler that extracts and structures website content
WaterCrawl is an open source web crawling and data extraction platform designed to transform website content into structured data suitable for machine learning and AI workflows. It enables developers and researchers to crawl web pages, extract meaningful information, and convert it into formats that are easier to process and analyze. It provides a modern crawling system that can automatically navigate links, control crawl depth, and collect content from targeted sections of a website. WaterCrawl supports customizable extraction rules so users can focus only on relevant elements while ignoring unnecessary page components. ... -
6
Foswiki is an Enterprise wiki, typically used to run a collaboration platform, knowledge base or document management system. Users can create wiki applications using the Topic Markup Language, and developers can extend its functionality with plugins. Foswiki stands for "Free and Open Source" wiki to emphasize its commitment to Open Source software.
-
7
This project features a basic php/mysql content management and a public customizable interface. (CakePHP features) multi-user access, e-shop profiles, CRUD posting.
-
8
DotnetSpider
Lightweight .NET framework for fast web crawling and data scraping
...It is designed to help developers create efficient and scalable crawlers for collecting structured data from websites. It provides a high-level API that simplifies the process of defining spiders, managing requests, and extracting content from web pages. Developers can create custom spiders by extending base classes and configuring pipelines that handle downloading, parsing, and storing collected data. DotnetSpider is modular, allowing different components such as request schedulers, downloaders, and storage systems to work together in a flexible workflow. DotnetSpider also supports distributed crawling environments, making it possible to scale data collection across multiple agents and machines. ... -
9
grab-site
Web crawler for archiving and backing up sites into WARC archives
grab-site is an open source web crawling tool designed to archive and back up websites by recursively downloading their content. It works by taking a starting URL and systematically following links across the site, capturing pages and resources and saving them into WARC archive files for long-term preservation. Internally, the crawler uses a fork of the wpull engine to fetch and process web pages efficiently during large-scale crawls. grab-site includes a built-in dashboard that displays real-time crawl activity, including which URLs are currently being processed and how many remain in the queue. ... -
Build Data Resilience - Take the Assessment TodayIs your recovery strategy as strong as you think? Take this quick self-assessment to check your recovery readiness and gain tailored insights. In only 2 minutes, you'll learn where you fall on the recovery readiness scale.
-
10
secp
secp
...The supported url schemes are ftp, scp, http, https, gridftp, file and nfs, with the possibility to perform authentication using basic FTP/HTTP authentication or more advanced SSO authentication schemas. The application analyses HTML pages to follow links and redirects, parses RDF and ATOM feeds, supports downloads of URL lists, automatically decompresses files and directories and many other feature. Tool works on a generic Linux distribution or on Windows (for windows, you need to install "Git for Windows") -
11
Simple PHP web frontend to the RRD databases filled by MRTG. Web pages, graph colors, sizes and legends customization. Easy navigation through the data sources. See demo site http://demo.grapherrd.org
-
12
WebBuild is a collection of scripts for Cygwin or UNIX shells, using awk and sed, to develop HTML pages in an easy way, having a template and source files containing the content to publish.
-
13
Shweb is a tiny web server written in shell script, POSIX compliant with most used small unix shell interpreters, like ash (busybox included), dash, and bash also. Support for static pages. Works in conjunction with any superdaemon like [x]inetd.
-
14
NijigenDownloader is a bash shell script that allow users to choose thumbnails ( this feature can be turned off ) before downloading the images from danbooru engine driven sites.
-
15
The Modular Manual Browser is a set of PHP4+ scripts designed to index manual pages across different operating systems and display them in a searchable database in a web browser.
-
16
E-Mail based Web Browsing. Provide a way to view and use many (but not all for semi-obvious reasons) web pages, with only an e-mail account. Ideal for Blackberry and other limited e-mail only wireless devices.
-
17
Generate you own gallery with thumbnails for the internet with this simple shell script. In the top of the script you have some things you can change (or not). All pages are HTML 4.0 and CSS compatible.
-
18
HTML Code Convert helps speed up the conversion of HTML code into different format including Java Script, JavaServer Pages, Microsoft ASP, PHP, Perl, and the UNIX Shell. It is particularly useful in CGI scripting.
-
19
This set of scripts is meant to build static web sites starting from a set of pages. It creates the menu bar (with javascript support) for each page. The site and menu bar look is themeable.
-
20
This one you must see! After stripping out comments, you get ca. 2Kb script. Serves static HTML/ASCII pages, ELF binaries, bash/perl scripts, GIF images. adding any other content type is trivial. Should be installed in /etc/inetd.conf.
-
21
A Collection of utilities, daemons, scripts, web pages that makes life a lot easier for system administrators (esp. those who work for/in an Internet Service Provider(s)).
- Previous
- You're on page 1
- Next
