Search Results for "robots"
Sort By:
Showing 24 open source projects for "robots"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
1
img2dataset
Easily turn large sets of image urls to an image dataset
...Can download, resize and package 100M urls in 20h on one machine. Also supports saving captions for url+caption datasets. Opt-out directives: Websites can pass the http headers X-Robots-Tag: noai, X-Robots-Tag: noindex , X-Robots-Tag: noimageai and X-Robots-Tag: noimageindex By default img2dataset will ignore images with such headers. -
2
Geziyor
Blazing fast Go framework for web crawling and data scraping tasks
...It provides a flexible architecture where developers define parsing functions that process responses and extract the desired data. Geziyor includes features for managing requests, handling cookies, respecting robots rules, and exporting collected data in multiple formats. With built-in tools for caching, metrics collection, and proxy management, it enables developers to build robust and customizable scraping systems using Go. -
3
AWStats
AWStats Log Analyzer
AWStats is a free powerful and featureful server logfile analyzer that shows you all your Web/Mail/FTP statistics including visits, unique visitors, pages, hits, rush hours, os, browsers, search engines, keywords, robots visits, broken links and more -
4
ahCrawler
A PHP search engine for your website and web analytics tool. GNU GPL3
ahCrawler is a set to implement your own search on your website and an analyzer for your web content. It can be used on a shared hosting. It consists of * crawler (spider) and indexer * search for your website(s) * search statistics * website analyzer (http header, short titles and keywords, linkchecker, ...) You need to install it on your own server. So all crawled data stay in your environment. You never know when an external webspider updated your content. Trigger a rescan... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
The GoodStat system is a web application, operating in the hosting environment, counting the statistics of entries, page views and much more. After downloading you will be able to install it yourself on your hosting. The data can be read as soon as the installation is completed and pasted into a monitored page on each subpage, a special JavaScript code. I would like to share with you the script I created called the GoodStat System. You will probably think that the name is a little bit...
-
6
dirhunt
Web crawler that finds hidden web directories without brute force
Dirhunt is an open source security tool designed to discover web directories and analyze website structures without relying on brute-force techniques. Instead of sending large numbers of guess-based requests, it operates as a specialized crawler that intelligently explores websites to identify accessible or hidden directories. Dirhunt can detect directories that expose “Index Of” listings, which may reveal files and other resources that were not intended to be publicly visible. It can also... -
7
crawlergo
Headless Chrome crawler for collecting URLs for vulnerability scans
crawlergo is a browser-based web crawler designed to collect URLs and request data that can be used by web vulnerability scanning tools. It uses a Chrome headless environment to render web pages and observe behavior during the DOM rendering stage in order to capture as many accessible endpoints as possible. By monitoring the page lifecycle and interacting with web elements, the crawler automatically triggers JavaScript events and navigational actions that would normally occur during real... -
8
Browser Pool
A Node.js library to easily manage and rotate a pool of web browsers
...We also wanted to easily and reliably manage the whole browser/page lifecycle. You can use Browser Pool for scraping the internet at scale, testing your website in multiple browsers at the same time or launching web automation robots. -
9
osFaq is a dynamic FAQ (Frequently Asked Questions) module which can be quickly modified to suit a range of website systems. See the osFaq website for more information.
-
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
10
DotNetWikiBot Framework
Make robots for MediaWiki-powered sites!
The DotNetWikiBot Framework was developed so that it can offer a helping hand with many complicated and routine tasks of wiki site development and maintenance. DotNetWikiBot Framework is a cross-platform full-featured client API, that allows you to build programs and web robots easily to manage information on MediaWiki-powered sites. DotNetWikiBot Framework can also be used for learning C# and .NET. -
11
Java Wiki Bot Framework helps with wiki (MediaWiki) site management. It allows to build robots to edit and dump information from Wikis. For more information and features see project homepage.
-
12
...The standard webStraktor output format is XML based, either in ASCII, UTF-8 or ISO-8859-1 (Latin1) code pages. webStraktor relies on the Apache HttpClient for retrieving content via the HTTP protocol. It adheres to the Robots Exclusion Protocol and it can be configured to operate in an anonymous way by connecting to the predominant types of web proxy servers. webStraktor extends the functionality of web crawlers, spiders or bots by integrating scraping and crawling capabilities.
-
13
FastQR
A Fast QR code detector for arbitrarily acquired images
Applications of Quick Response (QR) codes enable rich context interaction through creation of links between physical objects and internet resources. In spite of the widespread use of this kind of barcode, applications for visually impaired people and robots are not common because existing decoders assume that the symbol is properly framed during image acquisition. This project implements a two-stage component-based approach to perform accurate detection of QR code symbols in arbitrarily acquired images. In the first stage a cascade classifier to detect parts of the symbol is trained using the rapid object detection framework proposed by Viola-Jones. ... -
14
-
15
This javascript function replaces the native HTML "mailto" and avoids e-mail addresses to appear in HTML source pages. It should prevent possible spamers' robots to collect e-mail addresses automatically from the source HTML web pages where this scr
-
16
This is a Robot simulation game that allows you to write a robot in any language you might want. The robot communicates with the game using the internet and up to 32 robots can be run at a time. WARNING: The current version is not complete!
-
17
UniVeCS is a generic vehicle combat turn-based game system simulating a broad range of vehicles from starships and giant robots to cars and tanks in both single player and networked multi-player modes.
-
18
Adds a bottrap to the blog system b2evolution which can be simply installed and protects from adress crawlers and other robots which ignore the robots exclusion standard.
-
19
This CGI program can trap malicious robots that spider your website. The program works by blocking access from the bot's ip address. It can also provide an unlimited number of false e-mail addresses to muck up databases of email harvesting bots.
-
20
Plone CAPTCHA can prevent plone web sites from being abused by spam robots. Plone Captcha can be used in signup forms, blog comments etc.
-
21
PageCount is a kind of weblogger, logging either visits of real human or robots. In the log-details you get information about highly visited sites. Robots are marked in these statistics.
-
22
This small platform independent application (written in Java) is designed to encode your e-mail addresses, thus the spam robots can not retrieve it from your page. Note that minimal HTML knowledge is needed to put the generated script into a html page.
-
23
OpenAnonymity consists of a module for apache 2.0 Webserver and a framework that enables you to control search engine spider indexing on a word level, contrary to on file level as in Robots exclusion. OA could force Spiders to follow this rules.
-
24
Robots that run on Internet Chess Servers (i.e. FICS, ICC), including VoteBot, RoomBot, BabelBot, PlayBot, AnalyzeBot, FaceBot.
- Previous
- You're on page 1
- Next
