Search Results for "web crawler source code"
Sort By:
Showing 83 open source projects for "web crawler source code"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
Nipe
An engine to make Tor network your default gateway
Nipe is a Perl-based engine whose primary aim is to make the Tor network act as the default gateway for outgoing traffic. In practice, it configures system firewall rules (iptables) and network routing so that almost all IPv4 traffic is redirected through Tor. The tool provides commands such as install, start, stop, restart, and status to manage its behavior. When “start” is issued, it sets up the necessary rules; when “stop” is used, it attempts to remove those rules. Nipe currently... -
2
A general purpose source code indexer and cross-referencer that provides web-based browsing of source code with links to the definition and usage of any identifier. Supports multiple languages. Up-to-date information in http://lxr.sourceforge.net **CAUTION!** Releases are now issued on Codeberg due to legal reasons. See https://codeberg.org/ajlittoz/CB_LXRsource/releases
-
3
MisterHouse is a Windows/Unix home automation program written in Perl. It can respond to voice commands, web browsers, time of day, serial port and X10 data, external files, etc and can speak via Text to Speech engines. Support is on https://sourceforge.net/p/misterhouse/mailman/misterhouse-users/ and code is maintained on https://github.com/hollie/misterhouse
-
4
Easyspider - Distributed Web Crawler
Easy Spider is a distributed Perl Web Crawler Project from 2006
Easy Spider is a distributed Perl Web Crawler Project from 2006. It features code from crawling webpages, distributing it to a server and generating xml files from it. The client site can be any computer (Windows or Linux) and the Server stores all data. Websites that use EasySpider Crawling for Article Writing Software: https://www.artikelschreiber.com/en/ https://www.unaique.net/en/ https://www.unaique.com/ https://www.artikelschreiben.com/ https://www.buzzerstar.com/ https://easyperlspider.sourceforge.io/ https://www.sebastianenger.com/ https://www.artikelschreiber.com/opensource/ It is fun to look at some code that is few years ago and to see how one has improved himself. ... -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
5
This is software to create web dictionaries, esp. for Esperanto like Reta Vortaro (http://reta-vortaro.de). A dictionary is made from articles written in a special XML dialect by transformations using XSLT, ant and some Java code.
-
6
C-squares
Concise spatial query and representation system (c-squares)
C-squares is an easily implemented method for storage, querying and display of spatial data locations, based on a hierarchical, grid-based representation of the Earth' surface. Source code for encoding, decoding, mapping, etc. is provided via this site. Additional support is available by contacting the system developer, Tony.Rees@marinespecies.org; see also the c-squares home page at http://www.cmar.csiro.au/csquares/ . -
7
Perl Web Scraping Project
Perl Web Scraping Project
Web scraping (web harvesting or web data extraction) is data scraping used for extracting data from websites.[1] Web scraping software may access the World Wide Web directly using the Hypertext Transfer Protocol, or through a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying, in which specific data is gathered and copied from the web, typically into a... -
8
Open Game Panel
Web based Game server control panel
OGP has moved to GitHub. The source code hosted here is obsolete and is no longer being updated. Please visit our GitHub here: https://github.com/OpenGamePanel/ A PHP webapp (formerly known as hldstart2) used to manage server softwares, such as, Halflife1/2, UT2004, UrbanTerror4 and Warsow (and many more). Powerful features, great for game server companies, and single users. -
9
The scoop CMS code, of dailykos fame
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
Slash is a database-driven web application server, using Perl, Apache and MySQL. It is the code that runs Slashdot. Mailing lists and Git are here on Sourceforge.net.
-
11
CleanCode
.NET, PowerShell, SQL, Java, Perl, and Javascript developer libraries
Develop clean code with our .NET components (plus PowerShell, SQL, Java, Perl, and JavaScript components as well!). CleanCode highlights include user controls, a validation engine, a diagnostic system, an XML/HTML pre-processor, and a variety of articles on code design. -
12
Addons for IOSEC - DoS HTTP Security
IOSec Addons are enhancements for web security and crawler detection
IOSEC PHP HTTP FLOOD PROTECTION ADDONS IOSEC is a php component that allows you to simply block unwanted access to your webpage. if a bad crawler uses to much of your servers resources iosec can block that. IOSec Enhanced... -
13
Zoozle Search & Download Suchmaschine
Zoozle 2008 - 2010 Webpage, Tools and SQL Files
Download search engine and directory with Rapidshare and Torrent - zoozle Download Suchmaschine All The files that run the World Leading German Download Search Engine in 2010 with 500 000 unique visitors a day - all the tools you need to set up a clone. Code Contains: - PHP Files for zoozle - Perl Crawler for gathering new content to database and all other cool tools i have... -
14
Webman-framework
XAMPP Dedicated Web Application Framework
Lightweight, Component-based, and Database-oriented Web Application Framework. -
15
The Amazon Products Feed script was created to provide a current listing of products on your site using Amazon's XML Web Services to provide links for your visitors to purchase these items on Amazon.com using your affiliate code in the URL.
-
16
This Amazon Mechanical Turk (MTurk) SDK is no longer under active development as of 1/1/2018. The latest MTurk SDKs, with support for most common programming languages, are now a part of the Amazon Web Service (AWS) SDKs at https://aws.amazon.com/tools/. With the AWS SDKs, you can also connect to MTurk using the AWS Command Line Interface (https://aws.amazon.com/cli/), allowing you to perform operations from your Windows, Mac, or Linux command line without having to write code. If you...
-
17
Contemplate is a PHP-based, open source web templating system. You can store content, design templates and code in separate files, edit them with your favorite tools, then use Contemplate to merge them at runtime.
-
18
PRO-Search is a crawler of FTP servers, SMB shares, HTTP, dc++ networks, ... with powerful web search and navigation interface
-
19
This Perl module is intended to make it easy to create web forms by allowing you to describe them in a simple langauge. These descriptions are parsed and turned into CGI::FormBuilder objects.
-
20
Sql2xml is a perl cgi program that will help user or developer to request sql database query and convert to json, csv, xml or ini format through a web server. A single sql2xml support request from multiple user and multiple database
-
21
bee-rain is a web crawler that harvest and index file over the network. You can see result by bee-rain website : http://bee-rain.internetcollaboratif.info/
-
22
XBSDB is the tool to operate with data in JavaScript code like with SQL-data. XBSDB stores, arranges and selects data in your scripts. You can insert, delete, update and select records, you can use indexes. JSON-based methods allow data exchange.
-
23
Combine is an open system for crawling Internet resources. It can be used both as a general and focused crawler. If you want to download Web-pages pertaining to a particular topic (like 'Carnivorous Plants') Then Combine is the system for you!
-
24
Eleven is a programming language for creating robust, scalable web applications. It offers a 20x programmer productivity increase over ASP, JSP, etc. by automating state management and UI layout. The compiler generates ready-to-run PHP or mod_perl code.
-
25
PositLog is an open source CMS for building custom-made Websites. It provides you with the capability to write text, draw pictures, and paste photos and any HTML code anywhere on draggable and zoomable web pages.
