Menu
▾
▴
[xoops-svn] SF.net SVN: xoops:[9487] XoopsModules/xortify/cloud/2.06/htdocs/modules
|
From: <wis...@us...> - 2012-05-12 02:34:11
|
Revision: 9487
http://xoops.svn.sourceforge.net/xoops/?rev=9487&view=rev
Author: wishcraft
Date: 2012-05-12 02:33:59 +0000 (Sat, 12 May 2012)
Log Message:
-----------
Xortify Server 2.06 (RC) - Structural and Functional changes to Xortify Server - Contact wishcraft for guides on setting up cloud server. (Spiders Server Included)
Added Paths:
-----------
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/admin_header.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/index.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/menu.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/Spiders Agent's List.url
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/robots-all.txt
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/backend.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth_curl.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth_curl_provisionning.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth_json.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth_json_provisionning.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth_soap.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/auth_soap_provisionning.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/authfactory.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/auth/index.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/curl.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/index.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/json.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/modifications.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/soap.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/spiders.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/spiders_user.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/class/statistics.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/error_log
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/go.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/Thumbs.db
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/add.png
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/import.png
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/left_both.gif
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/list.png
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/right_both.gif
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/spiders.png
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/images/spiders_slogo.png
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/JSON.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/forms.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/functions.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/install.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/search.inc.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/uninstall.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/include/update.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/index.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/language/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/language/english/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/language/english/admin.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/language/english/main.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/language/english/modinfo.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/post.loader.footer.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/post.loader.spiders.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/preloads/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/preloads/core.php
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/preloads/index.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/spiders/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/sql/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/sql/spiders.sql
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/templates/
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/templates/spiders_footer_seo.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/templates/spiders_index.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/templates/spiders_robots.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/templates/spiders_robots_last.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/templates/spiders_robottxt.html
XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/xoops_version.php
Added: XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/admin_header.php
===================================================================
--- XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/admin_header.php (rev 0)
+++ XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/admin_header.php 2012-05-12 02:33:59 UTC (rev 9487)
@@ -0,0 +1,53 @@
+<?php
+// $Author: wishcraft $
+// ------------------------------------------------------------------------ //
+// XOOPS - PHP Content Management System //
+// Copyright (c) 2000 XOOPS.org //
+// <http://www.xoops.org/> //
+// ------------------------------------------------------------------------ //
+// This program is free software; you can redistribute it and/or modify //
+// it under the terms of the GNU General Public License as published by //
+// the Free Software Foundation; either version 2 of the License, or //
+// (at your option) any later version. //
+// //
+// You may not change or alter any portion of this comment or credits //
+// of supporting developers from this source code or any supporting //
+// source code which is considered copyrighted (c) material of the //
+// original comment or credit authors. //
+// //
+// This program is distributed in the hope that it will be useful, //
+// but WITHOUT ANY WARRANTY; without even the implied warranty of //
+// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the //
+// GNU General Public License for more details. //
+// //
+// You should have received a copy of the GNU General Public License //
+// along with this program; if not, write to the Free Software //
+// Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA //
+// ------------------------------------------------------------------------ //
+// Author: Simon Roberts (AKA wishcraft) //
+// URL: http://www.chronolabs.org.au //
+// Project: The XOOPS Project //
+// ------------------------------------------------------------------------- //
+
+include_once("../../../mainfile.php");
+include_once(XOOPS_ROOT_PATH."/class/xoopsmodule.php");
+include_once(XOOPS_ROOT_PATH."/include/cp_functions.php");
+include_once('../include/functions.php');
+
+if ( $xoopsUser ) {
+ $xoopsModule = XoopsModule::getByDirname('spiders');
+ if ( !$xoopsUser->isAdmin($xoopsModule->mid()) ) {
+ redirect_header(XOOPS_URL."/",3,_NOPERM);
+ exit();
+ }
+} else {
+ redirect_header(XOOPS_URL."/",3,_NOPERM);
+ exit();
+}
+if ( file_exists("../language/".$xoopsConfig['language']."/admin.php") ) {
+ include_once("../language/".$xoopsConfig['language']."/admin.php");
+} else {
+ include_once("../language/english/admin.php");
+}
+$myts =& MyTextSanitizer::getInstance();
+?>
\ No newline at end of file
Added: XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/index.php
===================================================================
--- XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/index.php (rev 0)
+++ XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/index.php 2012-05-12 02:33:59 UTC (rev 9487)
@@ -0,0 +1,501 @@
+<?php
+// $Author: wishcraft $
+// ------------------------------------------------------------------------ //
+// XOOPS - PHP Content Management System //
+// Copyright (c) 2000 XOOPS.org //
+// <http://www.xoops.org/> //
+// ------------------------------------------------------------------------ //
+// This program is free software; you can redistribute it and/or modify //
+// it under the terms of the GNU General Public License as published by //
+// the Free Software Foundation; either version 2 of the License, or //
+// (at your option) any later version. //
+// //
+// You may not change or alter any portion of this comment or credits //
+// of supporting developers from this source code or any supporting //
+// source code which is considered copyrighted (c) material of the //
+// original comment or credit authors. //
+// //
+// This program is distributed in the hope that it will be useful, //
+// but WITHOUT ANY WARRANTY; without even the implied warranty of //
+// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the //
+// GNU General Public License for more details. //
+// //
+// You should have received a copy of the GNU General Public License //
+// along with this program; if not, write to the Free Software //
+// Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA //
+// ------------------------------------------------------------------------ //
+// Author: Simon Roberts (AKA wishcraft) //
+// URL: http://www.chronolabs.org.au //
+// Project: The XOOPS Project //
+// ------------------------------------------------------------------------- //
+
+ include('admin_header.php');
+ include('../include/forms.php');
+
+ switch ($_REQUEST['op'])
+ {
+ case "send":
+
+ $id = intval($_GET['id']);
+ $api = apimethod();
+ include_once($GLOBALS['xoops']->path('/modules/spiders/class/'.$api.'.php'));
+ $func = strtoupper($api).'SpidersExchange';
+ $exchange = new $func;
+
+ $spiders_handler =& xoops_getmodulehandler('spiders', 'spiders');
+ $spider = $spiders_handler->get($id);
+
+ //Recieve From API
+ $exchange->sendSpider($spider->toArray());
+
+ redirect_header('index.php?op=list', 4, sprintf(_AM_SPIDERS_SENDDONE, $spider->getVar('robot-name')));
+ exit(0);
+ break;
+ case "compair-api":
+
+
+ $spider_handler = &xoops_getmodulehandler( 'spiders', _MI_SPIDERS_DIRNAME );
+ $spidermods_handler = &xoops_getmodulehandler( 'modifications', _MI_SPIDERS_DIRNAME );
+ $suser_handler = &xoops_getmodulehandler( 'spiders_user', _MI_SPIDERS_DIRNAME );
+ $member_handler = &xoops_gethandler( 'member' );
+
+ $modulehandler =& xoops_gethandler('module');
+ $confighandler =& xoops_gethandler('config');
+ $xoModule = $modulehandler->getByDirname('spiders');
+ $xoConfig = $confighandler->getConfigList($xoModule->getVar('mid'),false);
+
+ $api = $_POST['api'];
+ include_once($GLOBALS['xoops']->path('/modules/spiders/class/'.$api.'.php'));
+ $func = strtoupper($api).'SpidersExchange';
+ $exchange = new $func;
+
+ //Recieve From API
+ $apispiders = $exchange->getSpiders();
+
+ foreach($apispiders as $id => $apispider) {
+
+ $criteria = new CriteriaCompo();
+ $part = $spider_handler->safeAgent($apispider['robot-useragent']);
+ foreach(array(';','/',',','/','(',')',' ') as $split) {
+ $ret= array();
+ foreach(explode($split, $part) as $value) {
+ $ret[] = $value;
+ }
+ $part = implode(' ',$ret);
+ }
+ foreach($ret as $value)
+ if (!is_numeric((substr($value,0,1)))&&(substr($value,0,1))!='x')
+ if (!empty($value)) {
+ $criteria->add(new Criteria('`robot-safeuseragent`', '%'.$value.'%', 'LIKE'), 'OR');
+ $uagereg[] = strtolower($value);
+ $uageregb[] = $value;
+ }
+
+ $id = 0;
+ $spiders = $spider_handler->getObjects($criteria, true);
+
+ foreach($spiders as $spider) {
+
+ $suser = $suser_handler->get($spider->getVar('id'));
+ $robot = $member_handler->getUser( $suser->getVar('uid') );
+
+ $part = $spider_handler->safeAgent($spider->getVar('robot-useragent'));
+ foreach(array(';','/',',','\\','(',')',' ') as $split) {
+ $usersafeagent = array();
+ foreach(explode($split, $part) as $value) {
+ $usersafeagent[] = $value;
+ }
+ $part = implode(' ',$usersafeagent);
+ }
+ $usersafeagent = explode(' ', $part);
+ $match=0;
+ $dos_crsafe = array();
+
+ foreach($uagereg as $uaid => $ireg) {
+ if((in_array($ireg, $usersafeagent)||strpos(strtolower(' '.$part), strtolower($ireg)))&&!is_object($GLOBALS['xoopsUser'])) {
+ $match++;
+ $dos_crsafe[] = $uageregb[$uaid];
+ }
+ }
+
+ if (intval($match/count($uagereg)*100)>intval($xoConfig['match_percentile'])) {
+ $id = $spider->getVar('id');
+ $thespider = $spider;
+ }
+ }
+
+ $newmod = $spidermods_handler->create();
+
+ foreach($apispider as $key => $value){
+ if ($id<>0) {
+ if (md5($value)!=md5($thespider->getVar($key))&&strlen($value)<>strlen($thespider->getVar($key))) {
+ $change++;
+ $newmod->setVar($key, $value);
+ } else {
+ $newmod->setVar($key, $thespider->getVar($key));
+ }
+ } else {
+ $change++;
+ $newmod->setVar($key, $value);
+ }
+ }
+
+ $newmod->setVar('id', $id);
+
+ if (($change/count($apispider)*100)>intval($xoConfig['compair_percent'])) {
+ $spidermods_handler->insert($newmod, true);
+ }
+
+ }
+
+ redirect_header('index.php?op=listmods', 4, _AM_SPIDERS_COMPARISONFINISHED);
+ exit(0);
+ break;
+ case "signup":
+
+ switch ($_REQUEST['fct'])
+ {
+ case "save":
+
+ $xortifyAuth =& XortifyAuthFactory::getAuthConnection(false, apimethod());
+ $myts =& MyTextSanitizer::getInstance();
+ $uname = isset($_POST['uname']) ? $myts->stripSlashesGPC(trim($_POST['uname'])) : '';
+ $email = isset($_POST['email']) ? $myts->stripSlashesGPC(trim($_POST['email'])) : '';
+ $url = isset($_POST['url']) ? $myts->stripSlashesGPC(trim($_POST['url'])) : '';
+ $pass = isset($_POST['pass']) ? $myts->stripSlashesGPC(trim($_POST['pass'])) : '';
+ $vpass = isset($_POST['vpass']) ? $myts->stripSlashesGPC(trim($_POST['vpass'])) : '';
+ $agree = (isset($_POST['agree']) && intval($_POST['agree'])) ? 1 : 0;
+
+ if ($agree != 1) {
+ $stop .= _US_UNEEDAGREE . '<br />';
+ }
+
+ $validate = $xortifyAuth->validate($uname, $email, $pass, $vpass);
+
+ if ($validate!=false)
+ $stop .= "User details didn't validate with Xortify.com<br/>$validate";
+
+ xoops_load("captcha");
+ $xoopsCaptcha = XoopsCaptcha::getInstance();
+ if (! $xoopsCaptcha->verify() ) {
+ $stop .= $xoopsCaptcha->getMessage();
+ }
+
+ if ($stop!='') {
+ xoops_cp_header();
+ adminMenu(5);
+ echo "<p align='center' style='font-size: 15px; color: #FF0000;'>$stop</p>";
+ echo XortifySignupForm();
+ xoops_cp_footer();
+ exit(0);
+ } else {
+ @$xortifyAuth->create_user( $_REQUEST['viewemail'], $uname, $email, $url, $actkey,
+ $pass, $_REQUEST['timezone'], $_REQUEST['mailok'], $xortifyAuth->check_siteinfo(array()));
+
+ $moduleHandler =& xoops_gethandler('module');
+ $configHandler =& xoops_gethandler('config');
+ $xoModule = $moduleHandler->getByDirname('spiders');
+ $configs = $configHandler->getConfigs(new Criteria('conf_modid', $xoModule->mid()) );
+ foreach($configs as $id => $config)
+ switch($config->getVar('conf_name')) {
+ case 'xortify_username':
+ $config->setVar('conf_value', $uname);
+ @$configHandler->insertConfig($config);
+ break;
+ case 'xortify_password':
+ $config->setVar('conf_value', $pass);
+ @$configHandler->insertConfig($config);
+ break;
+ }
+ redirect_header("index.php", 4, _AM_SPIDERS_USERCREATED_PLEASEACTIVATE);
+ exit(0);
+ }
+ break;
+ default:
+ case "signup":
+ xoops_cp_header();
+ adminMenu(5);
+ echo XortifySignupForm();
+ xoops_cp_footer();
+ exit(0);
+ break;
+ }
+ break;
+
+ case "import-file":
+ import_robotstxt_org($_REQUEST['file']);
+ redirect_header('index.php', 3, _AM_SPIDERS_IMPORTCOMPLETE);
+ break;
+
+ case "save":
+
+ $spiders_handler =& xoops_getmodulehandler('spiders', 'spiders');
+ if (intval($_POST['id'])<>0)
+ $spider = $spiders_handler->get(intval($_POST['id']));
+ else
+ $spider = $spiders_handler->create();
+
+ $spider->setVar('robot-id', $_POST['robot-id'][intval($_POST['id'])]);
+ $spider->setVar('robot-name', $_POST['robot-name'][intval($_POST['id'])]);
+ $spider->setVar('robot-cover-url', $_POST['robot-cover-url'][intval($_POST['id'])]);
+ $spider->setVar('robot-details-url', $_POST['robot-details-url'][intval($_POST['id'])]);
+ $spider->setVar('robot-owner-name', $_POST['robot-owner-name'][intval($_POST['id'])]);
+ $spider->setVar('robot-owner-url', $_POST['robot-owner-url'][intval($_POST['id'])]);
+ $spider->setVar('robot-owner-email', $_POST['robot-owner-email'][intval($_POST['id'])]);
+ $spider->setVar('robot-status', $_POST['robot-status'][intval($_POST['id'])]);
+ $spider->setVar('robot-purpose', $_POST['robot-purpose'][intval($_POST['id'])]);
+ $spider->setVar('robot-type', $_POST['robot-type'][intval($_POST['id'])]);
+ $spider->setVar('robot-platform', $_POST['robot-platform'][intval($_POST['id'])]);
+ $spider->setVar('robot-availability', $_POST['robot-availability'][intval($_POST['id'])]);
+ $spider->setVar('robot-exclusion', $_POST['robot-exclusion'][intval($_POST['id'])]);
+ $spider->setVar('robot-exclusion-useragent', $_POST['robot-exclusion-useragent'][intval($_POST['id'])]);
+ $spider->setVar('robot-noindex', $_POST['robot-noindex'][intval($_POST['id'])]);
+ $spider->setVar('robot-host', $_POST['robot-host'][intval($_POST['id'])]);
+ $spider->setVar('robot-from', $_POST['robot-from'][intval($_POST['id'])]);
+ $spider->setVar('robot-useragent', $_POST['robot-useragent'][intval($_POST['id'])]);
+ $spider->setVar('robot-language', $_POST['robot-language'][intval($_POST['id'])]);
+ $spider->setVar('robot-description', $_POST['robot-description'][intval($_POST['id'])]);
+ $spider->setVar('robot-history', $_POST['robot-history'][intval($_POST['id'])]);
+ $spider->setVar('robot-environment', $_POST['robot-environment'][intval($_POST['id'])]);
+ $spider->setVar('modified-by', $_POST['modified-by'][intval($_POST['id'])]);
+ $spider->setVar('modified-date', $_POST['modified-date'][intval($_POST['id'])]);
+ $spider->setVar('robot-safeuseragent', $_POST['robot-safeuseragent'][intval($_POST['id'])]);
+
+ if ($spider->isNew()) {
+ $spiders_handler->import_insert($spider);
+ }
+
+ if ($spiders_handler->insert($spider))
+ redirect_header( $_SERVER['PHP_SELF'].'?op=edit&id='.$_REQUEST['id'] , 6 , _AM_SPIDERS_DATASAVEDSUCCESSFULLY) ;
+ else
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATASAVEDUNSUCCESSFULLY) ;
+
+
+ break;
+
+ case "merge":
+
+ $spiders_handler =& xoops_getmodulehandler('spiders', 'spiders');
+ $spidersmods_handler =& xoops_getmodulehandler('modifications', 'spiders');
+
+ if (intval($_REQUEST['modid'])<>0)
+ $mod = $spidersmods_handler->get(intval($_REQUEST['modid']));
+ else
+ $mod = $spiders_handler->create();
+
+ if (intval($mod->getVar('id'))<>0)
+ $spider = $spiders_handler->get(intval($mod->getVar('id')));
+ else
+ $spider = $spiders_handler->create();
+
+ $spider->setVar('robot-cover-url', $_POST['robot-cover-url'][intval($_POST['id'])]);
+ $spider->setVar('robot-details-url', $_POST['robot-details-url'][intval($_POST['id'])]);
+ $spider->setVar('robot-owner-name', $_POST['robot-owner-name'][intval($_POST['id'])]);
+ $spider->setVar('robot-owner-url', $_POST['robot-owner-url'][intval($_POST['id'])]);
+ $spider->setVar('robot-owner-email', $_POST['robot-owner-email'][intval($_POST['id'])]);
+ $spider->setVar('robot-status', $_POST['robot-status'][intval($_POST['id'])]);
+ $spider->setVar('robot-purpose', $_POST['robot-purpose'][intval($_POST['id'])]);
+ $spider->setVar('robot-type', $_POST['robot-type'][intval($_POST['id'])]);
+ $spider->setVar('robot-platform', $_POST['robot-platform'][intval($_POST['id'])]);
+ $spider->setVar('robot-availability', $_POST['robot-availability'][intval($_POST['id'])]);
+ $spider->setVar('robot-exclusion', $_POST['robot-exclusion'][intval($_POST['id'])]);
+ $spider->setVar('robot-exclusion-useragent', $_POST['robot-exclusion-useragent'][intval($_POST['id'])]);
+ $spider->setVar('robot-noindex', $_POST['robot-noindex'][intval($_POST['id'])]);
+ $spider->setVar('robot-host', $_POST['robot-host'][intval($_POST['id'])]);
+ $spider->setVar('robot-from', $_POST['robot-from'][intval($_POST['id'])]);
+ $spider->setVar('robot-useragent', $_POST['robot-useragent'][intval($_POST['id'])]);
+ $spider->setVar('robot-language', $_POST['robot-language'][intval($_POST['id'])]);
+ $spider->setVar('robot-description', $_POST['robot-description'][intval($_POST['id'])]);
+ $spider->setVar('robot-history', $_POST['robot-history'][intval($_POST['id'])]);
+ $spider->setVar('robot-environment', $_POST['robot-environment'][intval($_POST['id'])]);
+ $spider->setVar('modified-by', $_POST['modified-by'][intval($_POST['id'])]);
+ $spider->setVar('modified-date', $_POST['modified-date'][intval($_POST['id'])]);
+ $spider->setVar('robot-safeuseragent', $_POST['robot-safeuseragent'][intval($_POST['id'])]);
+
+ if ($spider->isNew()) {
+ $spider->setVar('robot-id', $_POST['robot-id'][intval($_POST['id'])]);
+ $spider->setVar('robot-name', $_POST['robot-name'][intval($_POST['id'])]);
+ $spiders_handler->import_insert($spider);
+ } else {
+ $spidersuser_handler =& xoops_getmodulehandler('spiders_users', 'spiders');
+ $suser = $spidersuser_handler->get($spider->getVar('id'));
+ $member_handler =& xoops_gethandler('member');
+ $xuser = $member_handler->getUser($suser->getVar('uid'));
+ if ($spider->getVar('robot-id')!=$_POST['robot-id'][intval($_POST['id'])]) {
+ $spider->setVar('robot-id', $_POST['robot-id'][intval($_POST['id'])]);
+ $xuser->setVar('uname', ucfirst($spider->getVar('robot-id')));
+ $member_handler->insertUser($xuser);
+ }
+ if ($spider->getVar('robot-name')!=$_POST['robot-name'][intval($_POST['id'])]) {
+ $spider->setVar('robot-name', $_POST['robot-name'][intval($_POST['id'])]);
+ $xuser->setVar('name', ucfirst($spider->getVar('robot-name')));
+ $member_handler->insertUser($xuser);
+ }
+ }
+
+ if ($spiders_handler->insert($spider)) {
+ $sql[0] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('spiders_modifications').' WHERE `modid` = "'.intval($_REQUEST['modid']).'"';
+ if ($GLOBALS['xoopsDB']->queryF($sql[0])) {
+ redirect_header( $_SERVER['PHP_SELF'].'?op=editmods' , 6 , _AM_SPIDERS_DATASAVEDSUCCESSFULLY) ;
+ } else {
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATADELETEDUNSUCCESSFULLY) ;
+ }
+ } else
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATASAVEDUNSUCCESSFULLY) ;
+
+
+ break;
+
+ case "savelist":
+
+ $spiders_handler =& xoops_getmodulehandler('spiders', 'spiders');
+
+ foreach($_POST['id'] as $oid => $id) {
+ $spider = $spiders_handler->get($id);
+ $spider->setVar('robot-exclusion-useragent', $_POST['robot-exclusion-useragent'][$id]);
+ $spider->setVar('robot-useragent', $_POST['robot-useragent'][$id]);
+ @$spiders_handler->insert($spider);
+ }
+
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATASAVEDSUCCESSFULLY) ;
+
+ break;
+
+ case "delete":
+
+ $spiders_handler =& xoops_getmodulehandler('spiders', 'spiders');
+ $spidersusers_handler =& xoops_getmodulehandler('spiders_user', 'spiders');
+
+ $suser = $spidersusers_handler->get($_REQUEST['id']);
+ $spider = $spiders_handler->get($_REQUEST['id']);
+
+ if (empty($_POST['confirmed'])) {
+ xoops_cp_header();
+ adminMenu(1);
+ xoops_confirm(array('confirmed' => true, 'id' => $_GET['id'], 'op' => $_GET['op']), $_SERVER['REQUEST_URI'], sprintf(_AM_SPIDERS_CONFIRM_DELETE, $spider->getVar('robot-name')));
+ xoops_cp_footer();
+ exit(0);
+ }
+
+ $sql[0] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('users').' WHERE `uid` = "'.$suser->getVar('uid').'"';
+ $sql[1] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('spiders').' WHERE `id` = "'.$spider->getVar('id').'"';
+ $sql[2] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('spiders_user').' WHERE `spider_id` = "'.$spider->getVar('id').'"';
+ $sql[3] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('spiders_statistics').' WHERE `id` = "'.$spider->getVar('id').'"';
+ $sql[4] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('spiders_modifications').' WHERE `id` = "'.$spider->getVar('id').'"';
+
+ if ($GLOBALS['xoopsDB']->queryF($sql[0])&&$GLOBALS['xoopsDB']->queryF($sql[1])&&$GLOBALS['xoopsDB']->queryF($sql[2])&&$GLOBALS['xoopsDB']->queryF($sql[3])
+ &&$GLOBALS['xoopsDB']->queryF($sql[4])) {
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATADELETEDSUCCESSFULLY) ;
+ } else {
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATADELETEDUNSUCCESSFULLY) ;
+ }
+ break;
+
+ case "deletemod":
+
+ $spidersmods_handler =& xoops_getmodulehandler('modifications', 'spiders');
+ $smod = $spidersmods_handler->get($_REQUEST['modid']);
+
+ if (empty($_POST['confirmed'])) {
+ xoops_cp_header();
+ adminMenu(1);
+ xoops_confirm(array('confirmed' => true, 'modid' => $_GET['modid'], 'op' => $_GET['op']), $_SERVER['REQUEST_URI'], sprintf(_AM_SPIDERS_CONFIRM_DELETE, $smod->getVar('robot-name')));
+ xoops_cp_footer();
+ exit(0);
+ }
+
+ $sql[0] = "DELETE FROM ".$GLOBALS['xoopsDB']->prefix('spiders_modifications').' WHERE `modid` = "'.intval($_POST['modid']).'"';
+
+ if ($GLOBALS['xoopsDB']->queryF($sql[0])) {
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATADELETEDSUCCESSFULLY) ;
+ } else {
+ redirect_header( $_SERVER['PHP_SELF'].'?op=list' , 6 , _AM_SPIDERS_DATADELETEDUNSUCCESSFULLY) ;
+ }
+ break;
+
+ case "mergemod":
+ xoops_cp_header();
+ adminMenu(3);
+
+ import_spidersmods_edit(intval($_GET['id']));
+
+ footer_adminMenu();
+
+ echo chronolabs_inline(false);
+ xoops_cp_footer();
+ exit;
+
+ break;
+
+ case "edit":
+ xoops_cp_header();
+ adminMenu(2);
+
+ import_spiders_edit(intval($_GET['id']));
+
+ footer_adminMenu();
+
+ echo chronolabs_inline(false);
+ xoops_cp_footer();
+ exit;
+
+ break;
+
+ case "add":
+ xoops_cp_header();
+ adminMenu(2);
+
+ import_spiders_edit(0);
+
+ footer_adminMenu();
+
+ echo chronolabs_inline(false);
+ xoops_cp_footer();
+ exit;
+
+ break;
+
+
+ case "listmods":
+ xoops_cp_header();
+ adminMenu(3);
+
+ import_spidersmods_list();
+
+ footer_adminMenu();
+
+ echo chronolabs_inline(false);
+ xoops_cp_footer();
+ exit;
+
+ break;
+
+ default:
+ case "list":
+ xoops_cp_header();
+ adminMenu(1);
+
+ import_spiders_list();
+
+ footer_adminMenu();
+
+ echo chronolabs_inline(false);
+ xoops_cp_footer();
+ exit;
+
+ break;
+ case "import":
+ xoops_cp_header();
+ adminMenu(4);
+
+ compair_spiders_form();
+
+ import_spiders_form();
+
+ footer_adminMenu();
+
+ echo chronolabs_inline(false);
+ xoops_cp_footer();
+ exit;
+ }
+?>
\ No newline at end of file
Added: XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/menu.php
===================================================================
--- XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/menu.php (rev 0)
+++ XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/menu.php 2012-05-12 02:33:59 UTC (rev 9487)
@@ -0,0 +1,48 @@
+<?php
+// $Author: wishcraft $
+// ------------------------------------------------------------------------ //
+// XOOPS - PHP Content Management System //
+// Copyright (c) 2000 XOOPS.org //
+// <http://www.xoops.org/> //
+// ------------------------------------------------------------------------ //
+// This program is free software; you can redistribute it and/or modify //
+// it under the terms of the GNU General Public License as published by //
+// the Free Software Foundation; either version 2 of the License, or //
+// (at your option) any later version. //
+// //
+// You may not change or alter any portion of this comment or credits //
+// of supporting developers from this source code or any supporting //
+// source code which is considered copyrighted (c) material of the //
+// original comment or credit authors. //
+// //
+// This program is distributed in the hope that it will be useful, //
+// but WITHOUT ANY WARRANTY; without even the implied warranty of //
+// MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the //
+// GNU General Public License for more details. //
+// //
+// You should have received a copy of the GNU General Public License //
+// along with this program; if not, write to the Free Software //
+// Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA //
+// ------------------------------------------------------------------------ //
+// Author: Simon Roberts (AKA wishcraft) //
+// URL: http://www.chronolabs.org.au //
+// Project: The XOOPS Project //
+// ------------------------------------------------------------------------- //
+
+
+$adminmenu[1]['title'] = _MI_SPIDERS_ADMINMENU1;
+$adminmenu[1]['link'] = "admin/index.php?op=list";
+$adminmenu[1]['icon'] = "images/list.png";
+$adminmenu[2]['title'] = _MI_SPIDERS_ADMINMENU2;
+$adminmenu[2]['link'] = "admin/index.php?op=add";
+$adminmenu[2]['icon'] = "images/add.png";
+$adminmenu[3]['title'] = _MI_SPIDERS_ADMINMENU3;
+$adminmenu[3]['link'] = "admin/index.php?op=listmods";
+$adminmenu[3]['icon'] = "images/list.png";
+$adminmenu[4]['title'] = _MI_SPIDERS_ADMINMENU4;
+$adminmenu[4]['link'] = "admin/index.php?op=import";
+$adminmenu[4]['icon'] = "images/import.png";
+$adminmenu[5]['title'] = _MI_SPIDERS_ADMINMENU5;
+$adminmenu[5]['link'] = "admin/index.php?op=signup&fct=signup";
+$adminmenu[5]['icon'] = "images/import.png";
+?>
\ No newline at end of file
Added: XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/Spiders Agent's List.url
===================================================================
--- XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/Spiders Agent's List.url (rev 0)
+++ XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/Spiders Agent's List.url 2012-05-12 02:33:59 UTC (rev 9487)
@@ -0,0 +1,5 @@
+[InternetShortcut]
+URL=http://www.robotstxt.org/dbexport.html
+IDList=
+[{000214A0-0000-0000-C000-000000000046}]
+Prop3=19,2
Added: XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/robots-all.txt
===================================================================
--- XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/robots-all.txt (rev 0)
+++ XoopsModules/xortify/cloud/2.06/htdocs/modules/spiders/admin/resources/robots-all.txt 2012-05-12 02:33:59 UTC (rev 9487)
@@ -0,0 +1,8833 @@
+
+robot-id: AdsBot-Google
+robot-name: AdsBot-Google
+robot-cover-url: http://www.google.com/
+robot-details-url: googlebot.com
+robot-owner-name: Google Inc.
+robot-owner-url: http://www.google.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type: Crawler
+robot-platform:
+robot-availability: Now
+robot-exclusion:
+robot-exclusion-useragent: AdsBot-Google (+http://www.google.com/adsbot.html)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: AdsBot-Google (+http://www.google.com/adsbot.html)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: AdsBot-Google (+http://www.google.com/adsbot.html)
+robot-handlesession: Yes
+
+robot-id: Baiduspider
+robot-name: Baiduspider
+robot-cover-url: http://www.baidu.com/
+robot-details-url: crawl.baidu.com
+robot-owner-name: Baidu.com
+robot-owner-url: http://www.baidu.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: Baiduspider subscriber
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Baiduspider
+robot-exclusion-useragent: Baiduspider+(+http://www.baidu.com/search/spider.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Baiduspider+(+http://www.baidu.com/search/spider.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Baiduspider+(+http://www.baidu.com/search/spider.htm)
+robot-handlesession: Yes
+
+robot-id: Bloglines
+robot-name: Bloglines
+robot-cover-url: http://www.bloglines.com/
+robot-details-url: *
+robot-owner-name: IAC Search & Media
+robot-owner-url: http://www.bloglines.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: Bloglines Images
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Bloglines-Images
+robot-exclusion-useragent: Bloglines-Images/0.1 (http://www.bloglines.com)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Bloglines-Images/0.1 (http://www.bloglines.com)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Bloglines-Images/0.1 (http://www.bloglines.com)
+robot-handlesession: Yes
+
+robot-id: Bloglines 0
+robot-name: Bloglines 0
+robot-cover-url: http://www.bloglines.com/
+robot-details-url: *
+robot-owner-name: IAC Search & Media
+robot-owner-url: http://www.bloglines.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Bloglines
+robot-exclusion-useragent: Bloglines/3.1 (http://www.bloglines.com)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Bloglines/3.1 (http://www.bloglines.com)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Bloglines/3.1 (http://www.bloglines.com)
+robot-handlesession: Yes
+
+robot-id: Bloglines 1
+robot-name: Bloglines 1
+robot-cover-url: http://www.bloglines.com/
+robot-details-url: *
+robot-owner-name: IAC Search & Media
+robot-owner-url: http://www.bloglines.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: Bloglines 1 Subscriber
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Bloglines
+robot-exclusion-useragent: Bloglines/3.1 (http://www.bloglines.com; 2 subscribers)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Bloglines/3.1 (http://www.bloglines.com; 2 subscribers)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Bloglines/3.1 (http://www.bloglines.com; 2 subscribers)
+robot-handlesession: Yes
+
+robot-id: Bloglines 3
+robot-name: Bloglines 3
+robot-cover-url: http://www.bloglines.com/
+robot-details-url: *
+robot-owner-name: IAC Search & Media
+robot-owner-url: http://www.bloglines.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: 3 subscribers
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Bloglines
+robot-exclusion-useragent: Bloglines/3.1 (http://www.bloglines.com; 3 subscribers)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Bloglines/3.1 (http://www.bloglines.com; 3 subscribers)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Bloglines/3.1 (http://www.bloglines.com; 3 subscribers)
+robot-handlesession: Yes
+
+robot-id: Charlotte 0.9
+robot-name: Charlotte 0.9
+robot-cover-url: http://www.searchme.com/
+robot-details-url: *
+robot-owner-name: Searchme
+robot-owner-url: http://www.searchme.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Charlotte/0.9t
+robot-exclusion-useragent: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.11) Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.11) Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (X11; U; Linux i686 (x86_64); en-US; rv:1.8.1.11) Gecko/20080109 (Charlotte/0.9t; http://www.searchme.com/support/)
+robot-handlesession: Yes
+
+robot-id: Charlotte 1.1
+robot-name: Charlotte 1.1
+robot-cover-url: http://www.searchme.com/
+robot-details-url: *
+robot-owner-name: Searchme
+robot-owner-url: http://www.searchme.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Charlotte/1.1
+robot-exclusion-useragent: Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; Charlotte/1.1; http://www.searchme.com/support/)
+robot-handlesession: Yes
+
+robot-id: DotBot
+robot-name: DotBot
+robot-cover-url: http://www.dotnetdotcom.org/
+robot-details-url: dotnetdotcom.org
+robot-owner-name: dotnetdotcom.org
+robot-owner-url: http://www.dotnetdotcom.org/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: DotBot/1.1
+robot-exclusion-useragent: Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, cr...@do...)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, cr...@do...)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, cr...@do...)
+robot-handlesession: Yes
+
+robot-id: FeedFetcher-Google
+robot-name: FeedFetcher-Google
+robot-cover-url: http://www.google.com/
+robot-details-url: google.com
+robot-owner-name: Google Inc.
+robot-owner-url: http://www.google.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Feedfetcher-Google
+robot-exclusion-useragent: Feedfetcher-Google; (+http://www.google.com/feedfetcher.html)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Feedfetcher-Google; (+http://www.google.com/feedfetcher.html)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Feedfetcher-Google; (+http://www.google.com/feedfetcher.html)
+robot-handlesession: Yes
+
+robot-id: Googlebot
+robot-name: Googlebot
+robot-cover-url: http://www.google.com/
+robot-details-url: googlebot.com
+robot-owner-name: Google Inc.
+robot-owner-url: http://www.google.com/
+robot-owner-email: ro...@xo...
+robot-status:
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Googlebot/2.1
+robot-exclusion-useragent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
+robot-handlesession: Yes
+
+robot-id: Java VM 1.4
+robot-name: Java VM 1.4
+robot-cover-url: http://java.sun.com/
+robot-details-url: *
+robot-owner-name: Sun Microsystems, Inc.
+robot-owner-url: http://java.sun.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Java/1.4.2
+robot-exclusion-useragent: Java/1.4.2
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Java/1.4.2
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Java/1.4.2
+robot-handlesession: Yes
+
+robot-id: Java VM 1.5
+robot-name: Java VM 1.5
+robot-cover-url: http://java.sun.com/
+robot-details-url: *
+robot-owner-name: Sun Microsystems, Inc.
+robot-owner-url: http://java.sun.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Java/1.4.1
+robot-exclusion-useragent: Java/1.4.1
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Java/1.4.1
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Java/1.4.1
+robot-handlesession: Yes
+
+robot-id: Java VM 1.6
+robot-name: Java VM 1.6
+robot-cover-url: http://java.sun.com/
+robot-details-url: *
+robot-owner-name: Sun Microsystems, Inc.
+robot-owner-url: http://java.sun.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Java VM 1.6
+robot-exclusion-useragent: Java VM 1.6
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Java VM 1.6
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Java VM 1.6
+robot-handlesession: Yes
+
+robot-id: LinkWalker 1
+robot-name: LinkWalker 1
+robot-cover-url: http://www.seventwentyfour.com/
+robot-details-url: *
+robot-owner-name: SEVENtwentyfour Inc.
+robot-owner-url: http://www.seventwentyfour.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: LinkWalker/2.0
+robot-exclusion-useragent: LinkWalker/2.0
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: LinkWalker/2.0
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: LinkWalker/2.0
+robot-handlesession: Yes
+
+robot-id: LiteFinder 1
+robot-name: LiteFinder 1
+robot-cover-url: http://www.litefinder.net/
+robot-details-url: *
+robot-owner-name: LiteFinder.net
+robot-owner-url: http://www.litefinder.net/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: LiteFinder/1.0
+robot-exclusion-useragent: Mozilla/5.0 (compatible; LiteFinder/1.0; +http://www.litefinder.net/about.html)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; LiteFinder/1.0; +http://www.litefinder.net/about.html)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; LiteFinder/1.0; +http://www.litefinder.net/about.html)
+robot-handlesession: Yes
+
+robot-id: msnbot 1.1
+robot-name: msnbot 1.1
+robot-cover-url: http://www.microsoft.com/
+robot-details-url: search.msn.com
+robot-owner-name: Microsoft
+robot-owner-url: http://www.microsoft.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: msnbot/1.1
+robot-exclusion-useragent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
+robot-handlesession: Yes
+
+robot-id: msnbot-media 1.0
+robot-name: msnbot-media 1.0
+robot-cover-url: http://www.microsoft.com/
+robot-details-url: search.msn.com
+robot-owner-name: Microsoft
+robot-owner-url: http://www.microsoft.com/
+robot-owner-email: ro...@xo...
+robot-status:
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: msnbot-media/1.0
+robot-exclusion-useragent: msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
+robot-handlesession: Yes
+
+robot-id: msnbot-media 1.1
+robot-name: msnbot-media 1.1
+robot-cover-url: http://www.microsoft.com/
+robot-details-url: search.msn.com
+robot-owner-name: Microsoft
+robot-owner-url: http://www.microsoft.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: msnbot-media/1.1
+robot-exclusion-useragent: msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
+robot-handlesession: Yes
+
+robot-id: msnbot/2.0b 1
+robot-name: msnbot/2.0b 1
+robot-cover-url: http://www.microsoft.com/
+robot-details-url: search.msn.com
+robot-owner-name: Microsoft
+robot-owner-url: http://www.microsoft.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: msnbot/2.0b
+robot-exclusion-useragent: msnbot/2.0b (+http://search.msn.com/msnbot.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: msnbot/2.0b (+http://search.msn.com/msnbot.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: msnbot/2.0b (+http://search.msn.com/msnbot.htm)
+robot-handlesession: Yes
+
+robot-id: msnbot/2.0b 2
+robot-name: msnbot/2.0b 2
+robot-cover-url: http://www.microsoft.com/
+robot-details-url: search.msn.com
+robot-owner-name: Microsoft
+robot-owner-url: http://www.microsoft.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: msnbot/2.0b
+robot-exclusion-useragent: msnbot/2.0b
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: msnbot/2.0b
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: msnbot/2.0b
+robot-handlesession: Yes
+
+robot-id: Sogou head 1.0
+robot-name: Sogou head 1.0
+robot-cover-url: http://www.sogou.com/
+robot-details-url: *
+robot-owner-name: Sogou.com
+robot-owner-url: http://www.sogou.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: Sogou head spider 1.0
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Sogou head spider/3.0
+robot-exclusion-useragent: Sogou head spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Sogou head spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Sogou head spider/3.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+robot-handlesession: Yes
+
+robot-id: Sogou web 4.0
+robot-name: Sogou web 4.0
+robot-cover-url: http://www.sogou.com/
+robot-details-url: *
+robot-owner-name: Sogou.com
+robot-owner-url: http://www.sogou.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: Sogou web spider 4.0
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Sogou web spider/4.0
+robot-exclusion-useragent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+robot-handlesession: Yes
+
+robot-id: Sosoimagespider
+robot-name: Sosoimagespider
+robot-cover-url: http://www.tencent.com/
+robot-details-url: *
+robot-owner-name: Tencent
+robot-owner-url: http://www.tencent.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Sosoimagespider
+robot-exclusion-useragent: Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Sosoimagespider+(+http://help.soso.com/soso-image-spider.htm)
+robot-handlesession: Yes
+
+robot-id: Sosospider
+robot-name: Sosospider
+robot-cover-url: http://www.tencent.com/
+robot-details-url: *
+robot-owner-name: Tencent
+robot-owner-url: http://www.tencent.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Sosospider
+robot-exclusion-useragent: Sosospider+(+http://help.soso.com/webspider.htm)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Sosospider+(+http://help.soso.com/webspider.htm)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Sosospider+(+http://help.soso.com/webspider.htm)
+robot-handlesession: Yes
+
+robot-id: WebAlta 2.0
+robot-name: WebAlta 2.0
+robot-cover-url: http://www.webalta.ru/
+robot-details-url: webalta.ru
+robot-owner-name: Webalta
+robot-owner-url: http://www.webalta.ru/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose: WebAlta Crawler 2.0
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: WebAlta Crawler/2.0
+robot-exclusion-useragent: WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU)
+robot-handlesession: Yes
+
+robot-id: Yahoo! Slurp
+robot-name: Yahoo! Slurp
+robot-cover-url: http://www.yahoo.com/
+robot-details-url: crawl.yahoo.net
+robot-owner-name: Yahoo! Inc.
+robot-owner-url: http://www.yahoo.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Yahoo! Slurp
+robot-exclusion-useragent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
+robot-handlesession: Yes
+
+robot-id: Yahoo! Slurp 3.0
+robot-name: Yahoo! Slurp 3.0
+robot-cover-url: http://www.yahoo.com/
+robot-details-url: crawl.yahoo.net
+robot-owner-name: Yahoo! Inc.
+robot-owner-url: http://www.yahoo.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Yahoo! Slurp/3.0
+robot-exclusion-useragent: Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp)
+robot-handlesession: Yes
+
+robot-id: Yahoo! Slurp China
+robot-name: Yahoo! Slurp China
+robot-cover-url: http://www.yahoo.com/
+robot-details-url: *
+robot-owner-name: Yahoo! Inc.
+robot-owner-url: http://www.yahoo.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Yahoo! Slurp China
+robot-exclusion-useragent: Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; Yahoo! Slurp China; http://misc.yahoo.com.cn/help.html)
+robot-handlesession: Yes
+
+robot-id: Yeti 1.0
+robot-name: Yeti 1.0
+robot-cover-url: http://www.nhncorp.com/
+robot-details-url: *
+robot-owner-name: NHN Corporation
+robot-owner-url: http://www.nhncorp.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Yeti/1.0
+robot-exclusion-useragent: Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
+robot-handlesession: Yes
+
+robot-id: YodaoBot 1.0
+robot-name: YodaoBot 1.0
+robot-cover-url: http://corp.163.com/
+robot-details-url: *
+robot-owner-name: NetEase Inc
+robot-owner-url: http://corp.163.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: YodaoBot/1.0
+robot-exclusion-useragent: Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; )
+robot-handlesession: Yes
+
+robot-id: YoudaoBot 1.0
+robot-name: YoudaoBot 1.0
+robot-cover-url: http://corp.163.com/
+robot-details-url: *
+robot-owner-name: NetEase Inc
+robot-owner-url: http://corp.163.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: YoudaoBot/1.0
+robot-exclusion-useragent: Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Mozilla/5.0 (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: (compatible; YoudaoBot/1.0; http://www.youdao.com/help/webmaster/spider/; )
+robot-handlesession: Yes
+
+robot-id: Bloglines 2
+robot-name: Bloglines 2
+robot-cover-url: http://www.bloglines.com/
+robot-details-url: *
+robot-owner-name: IAC Search & Media
+robot-owner-url: http://www.bloglines.com/
+robot-owner-email: ro...@xo...
+robot-status: Active
+robot-purpose:
+robot-type:
+robot-platform:
+robot-availability:
+robot-exclusion: Bloglines/3.1
+robot-exclusion-useragent: Bloglines/3.1 (http://www.bloglines.com; 2 subscribers)
+robot-noindex:
+robot-host: 40
+robot-from:
+robot-useragent: Bloglines/3.1 (http://www.bloglines.com; 2 subscribers)
+robot-language:
+robot-description: 40
+robot-history:
+robot-environment:
+modified-date:
+modified-by:
+robot-safeuseragent: Bloglines/3.1 (http://www.bloglines.com; 2 subscribers)
+robot-handlesession: Yes
+
+robot-id: acme-spider
+robot-name: Acme.Spider
+robot-cover-url: http://www.acme.com/java/software/Acme.Spider.html
+robot-details-url: http://www.acme.com/java/software/Acme.Spider.html
+robot-owner-name: Jef Poskanzer - ACME Laboratories
+robot-owner-url: http://www.acme.com/
+robot-owner-email: je...@ac...
+robot-status: active
+robot-purpose: indexing maintenance statistics
+robot-type: standalon...
[truncated message content] |
