Do a Search And Follow The Results

  • screamfine

    screamfine - 2005-09-16

    Hi there!

    I would like to have a script which does the following:

    1.) Search for a specific keyword (for example: garden) on a search engine like Google.

    2.) Follow the links of the results (let' say follow 10 result links).

    3.) Grab the text from those pages.

    How can I do that? Any examples? Is it possible with snoopy?

    • Jensen Somers

      Jensen Somers - 2005-09-19

      Of course it's possible.
      You just need to specify the url snoopy has to fetch.

      $term = 'garden';
      $res = $snoopy->fetch(''.$term);

      and then via while loops you can fetch each subpage and using substr and strpos filter the content of it.

    • runaway83

      runaway83 - 2005-10-06

      Hi all!

      I have a similar problem. I have written such a script and it works fine with google and msn, but not with yahoo.

      Does anyone of you can help me?

      Thanks a lot!


Log in to post a comment.

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:

JavaScript is required for this form.

No, thanks