pygoogle-discuss Mailing List for PyGoogle
Brought to you by:
bluecoat93
You can subscribe to this list here.
2004 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
|
Jul
(1) |
Aug
|
Sep
(1) |
Oct
(2) |
Nov
|
Dec
|
---|---|---|---|---|---|---|---|---|---|---|---|---|
2005 |
Jan
|
Feb
(1) |
Mar
|
Apr
(1) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
(1) |
Nov
|
Dec
|
2006 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
(1) |
Oct
(1) |
Nov
(3) |
Dec
|
2007 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
(2) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2008 |
Jan
(1) |
Feb
|
Mar
|
Apr
|
May
|
Jun
(1) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2009 |
Jan
|
Feb
|
Mar
|
Apr
(1) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
From: Knight S. <kni...@gm...> - 2009-04-03 07:01:23
|
Hi! I am trying to use the Google License key from Google AJAX API (google.com/apis) redirects to code.google.com. But it says invalid key. Same error occurs when I try to access the python script as a cgi-script from the url I specified while registering the key(http://localhost) Is this project dead or something ? I ask because I saw no recent bug reports of posts to this list. I really hope not, because PyGoogle seems very good and useful. Regards, Samar |
From: Dominik K. <do...@ko...> - 2008-06-22 06:16:01
|
Hi! I noticed that it is now impossible to get working SOAP Search API key. Without that key pygoogle is unusable. I found EvilAPI: http://sitening.com/evilapi/ which looks like it was a drop-in replacement for Google's SOAP Search API. Have you considered switching pygoogle to use it? Best wishes, Dominik |
From: Mitchell H. <mh8...@gm...> - 2008-01-10 19:23:06
|
Hello, I emailed about how to install PyGoogle several months back. For a while, I found another way to do my programming task, but as Google resists many of my crawler requests, I think I may have to use PyGoogle. Right now, I am trying to run the basic code below to see if I've installed PyGoogle correctly: import google google.LICENSE_KEY = '[the key that I got from Google]' data = google.doGoogleSearch('python') and I keep getting the error faultType: <Fault SOAP-ENV:Server: Exception from service object: Invalid authorization key: '[the key I got from Google]' Yet, I'm positive I didn't enter my google key incorrectly. I went to the Google Base Data API page, where it says 'your key is [the key I got from Google]' and 'This key is good for all URLs in this domain: http://www.google.com.' I'm thinking maybe I again may not have install PyGoogle correctly. Here is what I did: 1. Downloaded the Zip file of PyGoogle from Source Forge and saved it on my desktop 2. Copied and pasted the PyGoogle folder into my Python25 directory where I also have my file GoogleKey.txt 3. Typed 'python python setup.py install' so that several compiled python files (with a black shadow instead of no shadow for normal .py files) like google.pyc and googlesoapfacade.pyc were added to my Python25 directory. Is there anything I did incorrectly, or anything additional I need to do to install PyGoogle? Finally, if I wanted to get the number of webpages linking to a particular domain name (say YouTube.com) from Google, that is, the information you get when you type 'link:YouTube.com' in the Google search bar, is this something I can do with PyGoogle? Thank you very much, Mitch On Jul 17, 2007 1:42 AM, Chris Spencer <chr...@gm...> wrote: > On 7/17/07, Mitchell Hoffman <mh8...@gm...> wrote: > > Hello, > > > > I am brand new to PyGoogle and Python in general. I am trying to write > a > > spider to retrieve the number of results from a simple search engine > query > > (have the search engine search for all the terms in a column of an Excel > > spreadsheet and then return the number of results for each term). > > > > I tried looking on http://www.google.com/apis/ to find googlekey.txt, > but > > couldn't find it. Does anyone know where it is? > > The file googlekey.txt is something you have to create. In your Google > account there's a link somewhere (Google for it) reading something > like "email me my Google Key". Click that, copy the key from the > email, and save it to that text file. > > > Second, to install PyGoogle, I ran Setup.py from IDLE in my Python25 > drive. > > Then I opened another IDLE window and typed 'import google' and I got > > error saying the google module could not be found. So I manually copied > the > > four py files in PyGoogle ( Google.py, GoogleSoapFacade.py, > Googletest.py, > > and SOAP.py) into my Python 25. Now, after running SOAP.py, I am able > to do > > 'import google' without an error. Did I successfully install PyGoogle? > Is > > this the right way to install PyGoogle or will I experience problems > later? > > In general, you'll want to run setup.py from a command line, in the > form "python setup.py install" to install packages. It might have > worked from IDLE if you have run it with the "install" argument, but > it's easier to simply use the command line. > > > Third, is PyGoogle necessary to simply scrape the number of results? > Will > > simpler tools like UrlLib2 and UrlLib2 work for, or will Google > resist/block > > them? > > > If you're not doing large numbers of queries, you can get away with > urllib. Otherwise, Google will probably block you. After all, that is > why they provide an API. > > Regards, > Chris > |
From: Chris S. <chr...@gm...> - 2007-07-17 09:42:38
|
On 7/17/07, Mitchell Hoffman <mh8...@gm...> wrote: > Hello, > > I am brand new to PyGoogle and Python in general. I am trying to write a > spider to retrieve the number of results from a simple search engine query > (have the search engine search for all the terms in a column of an Excel > spreadsheet and then return the number of results for each term). > > I tried looking on http://www.google.com/apis/ to find googlekey.txt, but > couldn't find it. Does anyone know where it is? The file googlekey.txt is something you have to create. In your Google account there's a link somewhere (Google for it) reading something like "email me my Google Key". Click that, copy the key from the email, and save it to that text file. > Second, to install PyGoogle, I ran Setup.py from IDLE in my Python25 drive. > Then I opened another IDLE window and typed 'import google' and I got > error saying the google module could not be found. So I manually copied the > four py files in PyGoogle ( Google.py, GoogleSoapFacade.py, Googletest.py, > and SOAP.py) into my Python 25. Now, after running SOAP.py, I am able to do > 'import google' without an error. Did I successfully install PyGoogle? Is > this the right way to install PyGoogle or will I experience problems later? In general, you'll want to run setup.py from a command line, in the form "python setup.py install" to install packages. It might have worked from IDLE if you have run it with the "install" argument, but it's easier to simply use the command line. > Third, is PyGoogle necessary to simply scrape the number of results? Will > simpler tools like UrlLib2 and UrlLib2 work for, or will Google resist/block > them? If you're not doing large numbers of queries, you can get away with urllib. Otherwise, Google will probably block you. After all, that is why they provide an API. Regards, Chris |
From: Mitchell H. <mh8...@gm...> - 2007-07-17 09:10:09
|
Hello, I am brand new to PyGoogle and Python in general. I am trying to write a spider to retrieve the number of results from a simple search engine query (have the search engine search for all the terms in a column of an Excel spreadsheet and then return the number of results for each term). I tried looking on http://www.google.com/apis/ to find googlekey.txt, but couldn't find it. Does anyone know where it is? Second, to install PyGoogle, I ran Setup.py from IDLE in my Python25 drive. Then I opened another IDLE window and typed 'import google' and I got error saying the google module could not be found. So I manually copied the four py files in PyGoogle (Google.py, GoogleSoapFacade.py, Googletest.py, and SOAP.py) into my Python 25. Now, after running SOAP.py, I am able to do 'import google' without an error. Did I successfully install PyGoogle? Is this the right way to install PyGoogle or will I experience problems later? Third, is PyGoogle necessary to simply scrape the number of results? Will simpler tools like UrlLib2 and UrlLib2 work for, or will Google resist/block them? Thank you, Mitch Hoffman |
From: Anthony L. <ant...@ya...> - 2006-11-21 00:40:47
|
But we are limited to only 1000 queries a day. So, that while loop will soon exhaust the number of queries. Giovanni Marco Dall'Olio <dal...@gm...> wrote: hi, I don't know. It seems a very old problem. Actually I use something like this: ok = 0 while not ok: try: r_obj = google.doGoogleSearch(query) ok = 1 except: print 'Errore del server di google, aspetto un attimo e riprovo;' ok = 0 time.sleep(3) 2006/11/18, Anthony Liu : > A search of google found out that tons of people are having this annoying > HTTPError: > > "SOAPpy.Errors.HTTPError: " > > So, what is the solution? > > Thanks. > > > ________________________________ > Sponsored Link > > Mortgage rates near 39yr lows. $310,000 Mortgage for $999/mo - Calculate new > house payment > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share your > opinions on IT & business topics through brief surveys - and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > > _______________________________________________ > Pygoogle-discuss mailing list > Pyg...@li... > https://lists.sourceforge.net/lists/listinfo/pygoogle-discuss > > > -- ----------------------------------------------------------- Appunti di Bioinformatica Libera (esperimento): http://www.bioinformatici.org/appunti/ Visit my website! http://dalloliogm.altervista.org ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Pygoogle-discuss mailing list Pyg...@li... https://lists.sourceforge.net/lists/listinfo/pygoogle-discuss --------------------------------- Sponsored Link Mortgage rates near 39yr lows. $510,000 Mortgage for $1,698/mo - Calculate new house payment |
From: Giovanni M. Dall'O. <dal...@gm...> - 2006-11-20 16:46:20
|
hi, I don't know. It seems a very old problem. Actually I use something like this: <blockquote> ok = 0 while not ok: try: r_obj = google.doGoogleSearch(query) ok = 1 except: print 'Errore del server di google, aspetto un attimo e riprovo;' ok = 0 time.sleep(3) </blockquote> 2006/11/18, Anthony Liu <ant...@ya...>: > A search of google found out that tons of people are having this annoying > HTTPError: > > "SOAPpy.Errors.HTTPError: <HTTPError 502 Bad Gateway>" > > So, what is the solution? > > Thanks. > > > ________________________________ > Sponsored Link > > Mortgage rates near 39yr lows. $310,000 Mortgage for $999/mo - Calculate new > house payment > ------------------------------------------------------------------------- > Take Surveys. Earn Cash. Influence the Future of IT > Join SourceForge.net's Techsay panel and you'll get the chance to share your > opinions on IT & business topics through brief surveys - and earn cash > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV > > _______________________________________________ > Pygoogle-discuss mailing list > Pyg...@li... > https://lists.sourceforge.net/lists/listinfo/pygoogle-discuss > > > -- ----------------------------------------------------------- Appunti di Bioinformatica Libera (esperimento): http://www.bioinformatici.org/appunti/ Visit my website! http://dalloliogm.altervista.org |
From: Anthony L. <ant...@ya...> - 2006-11-18 20:31:01
|
A search of google found out that tons of people are having this annoying HTTPError: "SOAPpy.Errors.HTTPError: <HTTPError 502 Bad Gateway>" So, what is the solution? Thanks. --------------------------------- Sponsored Link Mortgage rates near 39yr lows. $310,000 Mortgage for $999/mo - Calculate new house payment |
From: Chris S <chr...@gm...> - 2006-10-04 02:38:39
|
I noticed that google.doGoogleSearch('define: <blah>') always returns 0 results, regardless of the value of <blah>. Is the "define:" keyword not support by PyGoogle? Regards, Chris |
From: Werner F. B. <wer...@fr...> - 2006-09-12 16:40:31
|
I just discovered pygoogle due to a write up in Programmez (www.programmez.com). I am trying to run this simple script: import google google.setLicense('mygooglekey') data = google.doGoogleSearch('python') for result in data.results: print result.URL But I receive this error: C:\Python25\Lib\site-packages\pygoogle\google.py:58: DeprecationWarning: SOAPpy not imported. Trying legacy SOAP.py. import GoogleSOAPFacade Traceback (most recent call last): File "mygoogletest.py", line 4, in <module> data = google.doGoogleSearch('python') File "C:\Python25\lib\site-packages\pygoogle\google.py", line 421, in doGoogleSearch outputencoding ) File "C:\Python25\lib\site-packages\pygoogle\SOAP.py", line 3621, in __r_call self.__hd, self.__ma) File "C:\Python25\lib\site-packages\pygoogle\SOAP.py", line 3541, in __call p, attrs = parseSOAPRPC(r, attrs = 1) File "C:\Python25\lib\site-packages\pygoogle\SOAP.py", line 2818, in parseSOAPRPC t = _parseSOAP(xml_str, rules = rules) File "C:\Python25\lib\site-packages\pygoogle\SOAP.py", line 2791, in _parseSOAP t = SOAPParser(rules = rules) File "C:\Python25\lib\site-packages\pygoogle\SOAP.py", line 1934, in __init__ xml.sax.handler.ContentHandler.__init__(self) TypeError: unbound method __init__() must be called with ContentHandler instance as first argument (got SOAPParser instance instead) Tried to install SOAPpy 0.12 but setup.py has an error. I am also wondering if you will at some point update to use the replacement for SOAPpy (ZSI)? Best regards Werner |
From: Ed H. <edh...@gm...> - 2005-10-25 22:07:57
|
what are some of the people on this list using this module for? just curiou= s ... -- edward hotchkiss |
From: John R. <joh...@gm...> - 2005-04-20 04:14:39
|
Hi. I just installed the pygoogle package with setup.py install home=3D.... and noticed that it put a directory named pygoogle in the sys.path directory I said. However, the pygoogle didn't contain a __init__.py file, so it wasn't recognized as a package, and I couldn't import from it. You should just add an empty __init__.py file, as I do below: % python Python 2.4 (#1, Nov 30 2004, 11:25:14)=20 [GCC 3.4.2 20041017 (Red Hat 3.4.2-6.fc3)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> from pygoogle import google Traceback (most recent call last): File "<stdin>", line 1, in ? ImportError: No module named pygoogle % touch lib/python/pygoogle/__init__.py % python Python 2.4 (#1, Nov 30 2004, 11:25:14)=20 [GCC 3.4.2 20041017 (Red Hat 3.4.2-6.fc3)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> from pygoogle import google /home/jtr/pagebites/trunk/build/lib/python/pygoogle/google.py:58: Deprecati= onWar ning: SOAPpy not imported. Trying legacy SOAP.py. import GoogleSOAPFacade >>> # i.e. it works. Well enough. |
From: Devine T. <Tho...@ly...> - 2005-02-07 17:16:07
|
Below is a simple Python program that used PyGoogle:- =20 1:import google 2:google.setLicense('/+iZkK1QFHIAXOxH1Owobs3BcArTHwIv') #=20 3:google.setProxy('fwa:8080')=20 4:data =3D google.doGoogleSearch('python') 5:print data.meta.searchTime 6:print data.results[0].URL 7:print data.results[0].title Line 3 sets the proxy server. However, the proxy servers in my network = REQUIRE user authentication with a valid username and password.=20 =20 Is there anyway I can use PyGoogle and authenticate??? regards thomas devine |
From: Ron S. <rd...@ma...> - 2004-10-31 23:40:48
|
I have uploaded a text file to my web server that is the exact same as my askmerlina.cgi file, except that it is named askmerlina.txt so that you can see it and copy and paste it or download it. If anyone wants the source code (or wants to help me modify the cgi script so that a user can enter their own Google license key instead of using mine (hint hint) ) then just go to www.awaretek.com/askmerlina.txt adn you will have it. Thanks Ron On Oct 31, 2004, at 12:51 PM, Ron Stephens wrote: > Hello. I am new to this list. I hope there is some activity on here? No, there really isn't any activity on this list. :( > I have a (very rough, I admit it) script using pyGoogle that runs on > the command line and can be found on my web site at > www.awaretek.com/plf.html . It takes questions from users and options > to decide amongst. What options are there? What kinds of questions can it answer? > There are also two online CGI versions there that are easy to try out, > first a "simple" one that takes a question and options to choose from > amongst only, then a second more "sophisticated" version that tries to > emulate the full command line version; but it doesn't get as good of > answers yet. I asked "What is the buick six?" and I got this: Traceback (most recent call last): File "/var/www/cgi-bin/askmerlin.cgi", line 351, in ? decide.turntheCrank() File "/var/www/cgi-bin/askmerlin.cgi", line 236, in turntheCrank self.choices = form['choices'].value.split(",") File "/usr/local/python/lib/python2.2/cgi.py", line 550, in __getitem__ raise KeyError, key KeyError: choices > So the command line version (merlina.py) is the one I am hoping > someone from this list might take the time to look at. I need to > refine the CGI versions. > > I am a but a poor coder but it's a fun hobby. I love pyGoogle and > Python. Pleas let me know if you have any suggestions. You can't be that poor if your program actually deciphers natural speech (see START at http://www.ai.mit.edu/projects/infolab/) > Maybe someone can build something better from the ideas I am trying > out? If not, I hope to be able to spend some time during the late > December holidays to refine and improved Ask Merlin, both the command > line version and the CGI versions. Again, see START > By the way, I originally did these scripts using web scraping > techniques, but of course as Google (and then Yahoo, which I switched > to) kept changing things the scripts that once worked kept breaking. > It was way too much work to waste time keeping up with. But now that I > switched to the Google API, it makes a lot more sense ;-)). > > Only problem is, today I already used up all of my 1000 queries, in > debugging my CGI versions of the scripts. ;-((( It looks like your online versions use YOUR personal google developer key, even when someone else is using your script. You should have people enter their own google developer key when they are using Merlin. Your web interface should also give the user some idea of how many queries it will use. > Anyway, don't expect too much, but if anyone looks at the scripts, I'm > eternally grateful Well I won't have time to really look at this until at least November 6th, but I'll be sure to give you some feedback at that point. 30 second response: List has been moribund. Look at effbot.org ElementTree package which has (much better IMO) Google functionality built in. Will try to look at your URL if no one responds before I get 5 minutes. On Sun, 2004-10-31 at 09:51, Ron Stephens wrote: > Hello. I am new to this list. I hope there is some activity on here? > > I have a (very rough, I admit it) script using pyGoogle that runs on > the command line and can be found on my web site at > www.awaretek.com/plf.html . It takes questions from users and options > to decide amongst. > > There are also two online CGI versions there that are easy to try out, > first a "simple" one that takes a question and options to choose from > amongst only, then a second more "sophisticated" version that tries to > emulate the full command line version; but it doesn't get as good of > answers yet. > > So the command line version (merlina.py) is the one I am hoping someone > from this list might take the time to look at. I need to refine the CGI > versions. > > I am a but a poor coder but it's a fun hobby. I love pyGoogle and > Python. Pleas let me know if you have any suggestions. > > Maybe someone can build something better from the ideas I am trying > out? If not, I hope to be able to spend some time during the late > December holidays to refine and improved Ask Merlin, both the command > line version and the CGI versions. > > By the way, I originally did these scripts using web scraping > techniques, but of course as Google (and then Yahoo, which I switched > to) kept changing things the scripts that once worked kept breaking. It > was way too much work to waste time keeping up with. But now that I > switched to the Google API, it makes a lot more sense ;-)). > > Only problem is, today I already used up all of my 1000 queries, in > debugging my CGI versions of the scripts. ;-((( > > Anyway, don't expect too much, but if anyone looks at the scripts, I'm > eternally grateful > > Ron Stephens > > www.awaretek.com/plf.html > > > > ------------------------------------------------------- > This SF.Net email is sponsored by: > Sybase ASE Linux Express Edition - download now for FREE > LinuxWorld Reader's Choice Award Winner for best database on Linux. > http://ads.osdn.com/?ad_id=5588&alloc_id=12065&op=click > _______________________________________________ > Pygoogle-discuss mailing list > Pyg...@li... > https://lists.sourceforge.net/lists/listinfo/pygoogle-discuss > |
From: Ron S. <rd...@ma...> - 2004-10-31 17:51:14
|
Hello. I am new to this list. I hope there is some activity on here? I have a (very rough, I admit it) script using pyGoogle that runs on the command line and can be found on my web site at www.awaretek.com/plf.html . It takes questions from users and options to decide amongst. There are also two online CGI versions there that are easy to try out, first a "simple" one that takes a question and options to choose from amongst only, then a second more "sophisticated" version that tries to emulate the full command line version; but it doesn't get as good of answers yet. So the command line version (merlina.py) is the one I am hoping someone from this list might take the time to look at. I need to refine the CGI versions. I am a but a poor coder but it's a fun hobby. I love pyGoogle and Python. Pleas let me know if you have any suggestions. Maybe someone can build something better from the ideas I am trying out? If not, I hope to be able to spend some time during the late December holidays to refine and improved Ask Merlin, both the command line version and the CGI versions. By the way, I originally did these scripts using web scraping techniques, but of course as Google (and then Yahoo, which I switched to) kept changing things the scripts that once worked kept breaking. It was way too much work to waste time keeping up with. But now that I switched to the Google API, it makes a lot more sense ;-)). Only problem is, today I already used up all of my 1000 queries, in debugging my CGI versions of the scripts. ;-((( Anyway, don't expect too much, but if anyone looks at the scripts, I'm eternally grateful Ron Stephens www.awaretek.com/plf.html |
From: Donny V. <sm...@th...> - 2004-09-09 07:43:13
|
Does anyone use this list? I've been subscribed for a day and haven't seen anything. I just wanted to ask what kind of programs exist that use PyGoogle since I couldn't find any myself. |
From: Sam P. <spe...@we...> - 2004-07-21 19:54:28
|
Am I missing something, or does PyGoogle not expose the <SOAP-ENV> XML string it gets back from the server? AFAICT the string is retrieved in SOAPProxy.__call r = self.transport.call(self.proxy, m, sa, encoding = self.encoding, http_proxy = self.http_proxy, config = self.config) and consumed in SOAPpy/Parser._parseSOAP, never to be seen again. I could expose it by creating a module-level global variable (yuk!) but it sure would be nice to just get the XML string without having to maintain my own version of SOAPProxy and possibly other modules. So--am I wrong about the string not being exposed? If not, is there a better way to expose it than a module-level variable given the current code base? Thanks, Sam |
From: Razafindrakoto J. C. <Jea...@ax...> - 2004-05-26 16:22:07
|
When trying the most simple sample code to test Pygoogle. I've been r= ejected by the firewall of m company. Did anyone know how to overcome this problem ? Thanks, Jean-CLaude =20 =20 ______________________________________________________________ AXA CESSIONS =20 Jean-Claude RAZAFINDRAKOTO =20 Re-ARMS Reinsurance - Actuarial and Risk Management Services =20 109 rue La Bo=E9tie 75008 Paris =20 Tel. : +33 1 56 43 78 54 Fax. : +33 1 56 43 78 70 E-mail : jea...@ax... _______________________________________________________________=20 |-----Message d'origine----- |De=A0: Peter Bengtsson [mailto:ma...@pe...] |Envoy=E9=A0: mercredi 26 mai 2004 12:03 |=C0=A0: pyg...@li... |Objet=A0: [Pygoogle-discuss] Quota per API | |Is it possible, with pyGoogle, to find out how much is left on your = quota? | |-- |Peter Bengtsson, http://www.peterbe.com | | |------------------------------------------------------- |This SF.Net email is sponsored by: Oracle 10g |Get certified on the hottest thing ever to hit the market... Oracle = 10g. |Take an Oracle 10g class now, and we'll give you the exam FREE. |http://ads.osdn.com/?ad_id=3D3149&alloc_id=3D8166&op=3Dclick |_______________________________________________ |Pygoogle-discuss mailing list |Pyg...@li... |https://lists.sourceforge.net/lists/listinfo/pygoogle-discuss |
From: Peter B. <ma...@pe...> - 2004-05-26 10:03:11
|
Is it possible, with pyGoogle, to find out how much is left on your quota? -- Peter Bengtsson, http://www.peterbe.com |