Do a Search And Follow The Results

Help
screamfine
2005-09-16
2013-05-30
  • screamfine

    screamfine - 2005-09-16

    Hi there!

    I would like to have a script which does the following:

    1.) Search for a specific keyword (for example: garden) on a search engine like Google.

    2.) Follow the links of the results (let' say follow 10 result links).

    3.) Grab the text from those pages.

    How can I do that? Any examples? Is it possible with snoopy?

     
    • Jensen Somers

      Jensen Somers - 2005-09-19

      Of course it's possible.
      You just need to specify the url snoopy has to fetch.

      $term = 'garden';
      $res = $snoopy->fetch('http://www.google.be/search?q='.$term);

      and then via while loops you can fetch each subpage and using substr and strpos filter the content of it.

       
    • runaway83

      runaway83 - 2005-10-06

      Hi all!

      I have a similar problem. I have written such a script and it works fine with google and msn, but not with yahoo.

      Does anyone of you can help me?

      Thanks a lot!

       

Log in to post a comment.

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:

JavaScript is required for this form.





No, thanks