Menu ▾ ▴

setFollowMode() Information

Help
Anonymous
2016-02-14
2016-02-16
  • Comment has been marked as spam. 
    Undo

    View and moderate all "Help" comments posted by this user

    Mark all as spam, and block user from posting to "Forum"

    Anonymous

    Anonymous - 2016-02-14

    Hi, i need information :)

    I want create a '1.5' follow mode. I want just check external URL in website. But i don't want crawler, crawl other website. Where should I change the code?

    For example i crawl current-domain.com, if crawler find other-domain.com, it check if domain return 200 http code. But it doesn't crawl other-domain.com.

    It's possible ?

    Thank in advance.

     
  • Comment has been marked as spam. 
    Undo

    View and moderate all "Help" comments posted by this user

    Mark all as spam, and block user from posting to "Forum"

    Anonymous

    Anonymous - 2016-02-14

    Maybe use referer ?

     

    Last edit: Anonymous 2016-02-15
  • Comment has been marked as spam. 
    Undo

    View and moderate all "Help" comments posted by this user

    Mark all as spam, and block user from posting to "Forum"

    Anonymous

    Anonymous - 2016-02-16

    Please help me, i have try in urlMatchesRules function :

    if ($this->general_follow_mode == 0 )
{


  if($this->CurrentDocumentInfo->referer_url != "")
  {


      $pos = strpos($this->CurrentDocumentInfo->referer_url, "website-to-crawl.com");
      if ( $pos <= 1 )
      { 

       return false; 
      }

  }
}

    but doesn't work

     

    Last edit: Anonymous 2016-02-16

Anonymous
Anonymous

Add attachments
Cancel