httplib2-discuss — The one and only mailing list for httplib2

[Httplib2-discuss] The unique nob

[Rudy V. <hef...@sp...>]

And when I had tendered some vague advice about the girl, and
made him promise to secure a night's rest (before

he faced the arduous tram-men's meeting in the morning) by taking

a sleeping-draught, I gave him some sulfonal in a phial. It is a new
drug, which produces protracted sleep without disturbing the digestion,
and which I use myself. He promised faithfully to take the draught; and
I also exhorted him earnestly to bolt and bar and lock himself in so as
to stop up every chink

or aperture by which the cold air of the winter's night might creep
into the room. I remonstrated
with him on the care

[Httplib2-discuss] illiant orange of his jaundice faded to lem

[Lingerfelter K. <dig...@vv...>]

E is seen two hours later following the Captain up to London by the
next train." She seemed to be considering

it. "How many people," she said, "know that

Charlie was in that train? People that matter--I don't mean you and
Norah."

"Your butler, your
parlourmaid, your housemaid, your cook, your gardener--by this
time--and Baby's nurse--" ("And Baby," she interrupted.) "--The guard
of the train, the booking clerks and porters at Midhurst and Selham,
and the station-masters at Midhurst and Selham and Petworth (probably)
and Fittleworth. Quite a number of important people,

to say nothing of Kendal,
who is perhaps the most important of them all."

"And who was it who brought Kendal into it?" I was silent. "Nobody but
you, Furny, or a born fool, would have dreamed of bringing
Kendal in." I said that a little reflection would show her
that it was impossible to keep him out. To this she said, "Please go
and find Norah. I want her." I found Norah. I warned her that Viola was
going to be extremely difficult. She said it would be all right if I
left Viola to her. As we approached, Viola turned to her sister with an
air of outraged and long-suffering dignity. "Norah,"
she said. "I do wish you would make Wally see what
an ass he's making of himself." My wife said, in
her admirable, judicial way, "How an ass?" "Well--trying to make me go
back and bringing Kendal out here

to fetch me. He doesn't seem to see that if I do go back with him it'll
be as good as proclaiming to everybody that
I ran away with Charlie and was found out by

my clever brother-in-law who tracked me down in my husband's motor-car
and brought me back in it. Whereas, if I go quietly

on to London, as I meant to and as everybody knows I meant to,
it'll be all right." "It won't," I said, "as long as Charlie's there.
It will be if you come home with us in the
car now, and go up to town with Norah and me on Monday."
"I've told you," she said wearily, "that I can't go back because I
shall never get away if I do. And I _must_-

[Httplib2-discuss] Your wife photos attached

[Munger B. <hil...@pd...>]

Your wife photos

[Httplib2-discuss] Ain. Zara, however, seemed to be all right. She was brighter

[Zelenko D. <pir...@in...>]

{\rtf1\ansi\ansicpg1251\deff0\deflang1049{\fonttbl{\f0\fswiss\fprq2\fcharset204{\*\fname Arial;}Arial CYR;}{\f1\fswiss\fcharset204{\*\fname Arial;}Arial CYR;}}
{\colortbl ;\red0\green0\blue255;\red0\green128\blue0;}
{\*\generator Msftedit 3.1.17.98;}\viewkind4\uc1\pard\sa200\sl276\slmult1\lang9\f0\fs32{\field{\*\fldinst{HYPERLINK "h{\*\dd 3.1.17.98;}ttp://clubmillions.info"}}{\fldrslt{\ul\cf1 http://clubmillions.info}}}\f0\cf1\b\fs32  - ONLINE CASINO!\par
\line\cf2\b\f0\fs28 VIP CLUB Casino is a great online casino that offers the unique combination of top quality games, high payouts and a 24/7 professional customer support.\par
\par100 progressive games with towering jackpots, which are ready to explode and can make multi-millionaires out of VIP CLUB players! Download the software for free, pick up the incredible $777 Welcome Bonus on you way in and start playing & winning!\par
}

[Httplib2-discuss] Stic one, and moreover in terms of

[Depippo S. <nep...@rc...>]

{\rtf1\ansi\ansicpg1251\deff0\deflang1049{\fonttbl{\f0\fswiss\fprq2\fcharset204{\*\fname Arial;}Arial CYR;}{\f1\fswiss\fcharset204{\*\fname Arial;}Arial CYR;}}
{\colortbl ;\red0\green0\blue255;\red0\green128\blue0;}
{\*\generator Msftedit 5.10.27.3956;}\viewkind4\uc1\pard\sa200\sl276\slmult1\lang9\f0\fs32{\field{\*\fldinst{HYPERLINK "h{\*\dd 5.10.27.3956;}ttp://goldrushonline.info"}}{\fldrslt{\ul\cf1 http://goldrushonline.info}}}\f0\cf1\b\fs32  - ONLINE CASINO!\par
\line\cf2\b\f0\fs28 VIP CLUB Casino is a great online casino that offers the unique combination of top quality games, high payouts and a 24/7 professional customer support.\par
\par100 progressive games with towering jackpots, which are ready to explode and can make multi-millionaires out of VIP CLUB players! Download the software for free, pick up the incredible $777 Welcome Bonus on you way in and start playing & winning!\par
}

[Httplib2-discuss] fique rico na internet

[nilda b. <nil...@ho...>]

pessoal acabou de ser lançada esta rede social sei q voce esta pensando 
mais um negocio . te digo nao este realmente e incrivel . 
 imagina se o orkut te pagace pelo menos  1% de tudo q ele faz 
isto mesmo esta rede vai te pagar no minimo mil dolares por semanna 
com um unico pagamento estamos ja em 180 paises gente corre pq nao e
brincadeira nao , chegou nossa vez de ganhar na internet de verdade veja
uma reuniao . q voce vai se espantar com os ganhos . incrivel fabuloso
simplimente . voce ano e obrigado a indicar ninguem . o proximo 
apos voce ja esua rede e so duas abaixo de voce e fecah seu circulo 
 cadstre-se  acabou de ser lançado .
www.vicss.com/nilda


www.vicss.com/nilda

mais informaçoes skype : nildabaldaia
Email Marketing
Clique neste link para ser removido:
http://bhipglobal.com.br/email/unsubscribe.php?M=191062&C=75612ae5e69682cf72f932f3df5bc9c9&L=35&N=314

[Httplib2-discuss] Sible, was of metal, connecting with the other metal

[Heinonen <bio...@pa...>]

D to end of the Wondership's body. These long copper wires were to form the aerials by which the messages from Mr. Chadwick's workshop were to be caught. The smaller wires underneath were connected with the metal work

of the engine. These wires formed a
"ground" similar to the kind employed in aerial wireless telegraphy. The details of the Wondership having been fully described in the Boy Inventors' Flying Ship, we shall not enter here into any but a brief
and general description of the craft. The Wondership,
then, was a combination of dirigible balloon, automobile and boat.
Her motive power was furnished by engines driven by an explosive volatile gas which was also used when occasion arose to inflate the bag of the balloon feature of her design. The gas was generated in t

[Httplib2-discuss] Ntibus te, per Iesum Christum. Amen._ We thank thee, heav

[Tamayo B. <enf...@hw...>]

Ll both in Body and Mind. _Ans._ I'll promise you I will do my
Endeavour. Fare you well also; and I again wish you prosperous

[Httplib2-discuss] all over the barn floor. "Oh, dea

[Darnall <hyd...@co...>]

Acation, the school children ran on through the streets of Lakeport.
"Let's have a race!" cried Bunny. "I can beat you!" declared Charlie
Star. Off they ran, feet fast flying, and Bunny was first to reach the
hitching post in front of his house, this being the end of the race
course for that particular time. "Did Bunker Blue come back with Toby?"
asked Bunny of his mother, after he had been given a piece of bread and
sugar by Mary. "No," was the answer. "But how did you know Bunker had
Toby out? He didn't come for him until after you went to school," said
Mrs. Brown. "Oh, Toby came to school!" explained Sue, laughing. "Toby
came to school?" repeated her mother. And then the story was told amid
much laughter. Just before supper Bunker Blue came back with Toby, and
the children were allowed to hitch the Shetland pony to the basket cart.
"Do you want anything from the store?" asked Bunny, as he took his seat
beside Sue and grasped the pony's reins. "Better ask Mary," was the
reply. And, as it happe

[Httplib2-discuss] s family and among them a

[Caudill <the...@pr...>]

 when about half way down they halted suddenly under an oak tree and
accused their

[Httplib2-discuss] 人妻サークル

[情報局 <pwo...@ya...>]

このサイトの運営者は既婚者、つまり人妻です。
旦那に不満がある人。不満はなくても別の男性と恋愛をしたいという複数の人妻が集まり、運営しています。

http://yo67.net/?bc=mark&me=lH74N3H84JR9PoH7SH3H3JHH8bjYjb9Q4H9SH86HR9P9g883EO69RQRJ2B8H2JH9APVBhYVM1H87
▽広報担当の由香です。このサイトは元々「結婚してても恋愛もしたい」という女性が集まった「サークル」みたいなものでした。
少しずつ男女会員が集まり、おかげさまでこのように出会いサイトととして立ち上げることになりました。
元々がサークルなので女性会員数には自信があります。会員女性の質にも自信を持っています。「質」というのは、見た目の事ではありません。見た目の好みは人それぞれ違うものですから。

割り切って真剣に出会いを望む女性たちばかりですので、ぜひここでステキなパートナーを見つけてください。
直接電話やメールで連絡をとれますが、相手の女性は既婚者です。ルールを守り、プライベートの詮索などはしないようにお願いします。

http://yo67.net/?bc=mark&me=lH74N3H84JR9PoH7SH3H3JHH8bjYjb9Q4H9SH86HR9P9g883EO69RQRJ2B8H2JH9APVBhYVM1H87











配信拒否はこちらまで
ca...@yo...

Re: [Httplib2-discuss] Best way of retrieving a page as a unicode string?

[Simon W. <si...@si...>]

On 8 Dec 2007, at 22:10, Joe Gregorio wrote:

> Oh, if it were only that simple :) For example, look at the
> charset sniffing rules for JSON (RFC 4627) and XML 1.0
> <http://www.w3.org/TR/REC-xml/#sec-guessing>. You're
> best bet will probably be to use:
>
>    <http://chardet.feedparser.org/>

But surely you can attempt to decode using the charset declared in  
the Content-Type header, and then fall back on the chardet library if  
a decoding error occurs? Or am I missing something really scary?

Cheers,

Simon

Re: [Httplib2-discuss] Best way of retrieving a page as a unicode string?

[Joe G. <jo...@bi...>]

On Dec 8, 2007 4:54 PM, Simon Willison <si...@si...> wrote:
> Is there a supported way of getting hold of a page as a Python unicode
> string with httplib2? As far as I can tell I need to do this:
>
> import httplib2
> h = httplib2.Http()
> headers, content = h.request('http://simonwillison.net/', 'GET')
> content_type = headers.get('content-type', '')
> if 'charset' in content_type:
>     junk, charset = content_type.split('charset=', 2)
> else:
>     charset = 'iso-8859-1'
> unicode_content = content.decode(charset)

Oh, if it were only that simple :) For example, look at the
charset sniffing rules for JSON (RFC 4627) and XML 1.0
<http://www.w3.org/TR/REC-xml/#sec-guessing>. You're
best bet will probably be to use:

   <http://chardet.feedparser.org/>

At the very least I should have a link to chardet in the
httplib2 documentation. Not sure if httplib2 should do
more than that.

   -joe

>
> Even the above doesn't look like it would properly solve the problem
> (I'm not sure if that's the best assumption for a default encoding,
> and I should probably be catching any unicode decoding exceptions and
> falling back on something else if they occur). Shouldn't this be
> handled by the library in some way?
>
> Cheers,
>
> Simon Willison
>
> -------------------------------------------------------------------------
> SF.Net email is sponsored by:
> Check out the new SourceForge.net Marketplace.
> It's the best place to buy or sell services for
> just about anything Open Source.
> http://sourceforge.net/services/buy/index.php
> _______________________________________________
> Httplib2-discuss mailing list
> Htt...@li...
> https://lists.sourceforge.net/lists/listinfo/httplib2-discuss
>



-- 
Joe Gregorio        http://bitworking.org

[Httplib2-discuss] Best way of retrieving a page as a unicode string?

[Simon W. <si...@si...>]

Is there a supported way of getting hold of a page as a Python unicode
string with httplib2? As far as I can tell I need to do this:

import httplib2
h = httplib2.Http()
headers, content = h.request('http://simonwillison.net/', 'GET')
content_type = headers.get('content-type', '')
if 'charset' in content_type:
    junk, charset = content_type.split('charset=', 2)
else:
    charset = 'iso-8859-1'
unicode_content = content.decode(charset)

Even the above doesn't look like it would properly solve the problem
(I'm not sure if that's the best assumption for a default encoding,
and I should probably be catching any unicode decoding exceptions and
falling back on something else if they occur). Shouldn't this be
handled by the library in some way?

Cheers,

Simon Willison

[Httplib2-discuss] Move complete

[Joe G. <jo...@bi...>]

I have finished moving httplib2 from sourceforge over to code.google.com.
Please change your email subscription to:

  http://groups.google.com/group/httplib2-dev

There is also a commit mailing list available:

  http://groups.google.com/group/httplib2-commit

The commit list will get emails for every svn commit, which
includes wiki page changes. It will also get emails
for every change in the issue tracker. You've been warned.

   Thanks,
   -joe

-- 
Joe Gregorio        http://bitworking.org

Re: [Httplib2-discuss] Moving to code.google.com

[Joe G. <jo...@bi...>]

On 7/30/07, Joe Gregorio <jo...@bi...> wrote:
> This is just a heads up that over the next day or two
> I will be migrating httplib2 over to code.google.com. I will
> send out another notice once the move is complete.

I've been asked for more details about the motivation for
the move. First is just the scale of the project; httplib2 isn't
a big project and SF just has way too many knobs, it presents
a very large dashboard for such a small project.
Also as httplib2 becomes more stable the majority
of the work will shift into documentation and that will be
made easier by the wiki. Third is the integration points:
I have wanted to create a mailing list for checkins but
have put it off under SF knowing what a pain it can be.
Creating just such a mailing list/google group under
code.google.com is trivial in comparison. And finally, the
speed of the web interface for code.google.com is
substantially faster than SF.

All in all it is going to make managing the project much
faster and easier with no loss in functionality.

   Thanks,
   -joe

-- 
Joe Gregorio        http://bitworking.org

[Httplib2-discuss] Moving to code.google.com

[Joe G. <jo...@bi...>]

This is just a heads up that over the next day or two
I will be migrating httplib2 over to code.google.com. I will
send out another notice once the move is complete.

   Thanks,
   -joe

-- 
Joe Gregorio        http://bitworking.org

Re: [Httplib2-discuss] Need to specify IP address for client socket (or provide custom HTTPConnection)

[Joe G. <jo...@bi...>]

On 7/30/07, Simon Willison <si...@si...> wrote:
> Unfortunately httplib2 doesn't currently provide a hook for
> substituting in a custom HTTPConnection implementation - it is hard
> coded to pick between HTTPConnectionWithTimeout and
> HTTPSConnectionWithTimeout. It would be really useful if there was a
> way to provide a custom HTTPConnection - in my case, I'd provide one
> that knows how to bind to a specified client socket IP address.
> Alternatively, adding direct support for my use case to the httplib2
> library would be useful.

That use case is a little too obscure even for me to think we should
add something to the library to support it directly (and I'm the
guy that added HMACDigest support!).

On the other hand, adding support for a way to provide a custom
HTTPConnection sounds like a great idea. It should even be useful in
creating unit tests instead of monkey patching httplib.

It was also fairly easy to implement and test. This is now available
on the trunk.

   Thanks,
   -joe

-- 
Joe Gregorio        http://bitworking.org

[Httplib2-discuss] Need to specify IP address for client socket (or provide custom HTTPConnection)

[Simon W. <si...@si...>]

Hi all,

Had an interesting edge case come up today. I'm talking to a web
service from a machine with two public-facing IP addresses. The web
service in question is configured to only allow requests from one of
them, so I need to be able to force my request to come from a specific
IP address.

After much research, it appears that the way to do this is to call the
.bind() method on the socket object directly after it is created:

self.sock = socket.socket(af, socktype, proto)
self.sock.bind((required_ip_address, 0))

Using 0 for the port number tells the operating system to pick an
available port.

Unfortunately httplib2 doesn't currently provide a hook for
substituting in a custom HTTPConnection implementation - it is hard
coded to pick between HTTPConnectionWithTimeout and
HTTPSConnectionWithTimeout. It would be really useful if there was a
way to provide a custom HTTPConnection - in my case, I'd provide one
that knows how to bind to a specified client socket IP address.
Alternatively, adding direct support for my use case to the httplib2
library would be useful.

Cheers,

Simon

Re: [Httplib2-discuss] 400 error when re-fetching certain pages

[Joe G. <jo...@bi...>]

Ross,
   Thanks, this is repeatable for me also. The problem is that httplib2
isn't handling
the odd, but perfectly legal, value of "0" for the Expires: header.
Logged as a bug, I will fix this in the morning.

   Thanks,
   -joe

On 5/26/07, Ross M Karchner <ros...@gm...> wrote:
>
> On 5/26/07, Ross M Karchner <ros...@gm...> wrote:
> > If I run the program below twice, the first time it succeeds (200),
> > and the second time it fails (400).
>
> I forgot to add, I duplicated this with the current svn code, on OS X and
> Linux.
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by DB2 Express
> Download DB2 Express C - the FREE version of DB2 express and take
> control of your XML. No limits. Just data. Click to get it now.
> http://sourceforge.net/powerbar/db2/
> _______________________________________________
> Httplib2-discuss mailing list
> Htt...@li...
> https://lists.sourceforge.net/lists/listinfo/httplib2-discuss
>



-- 
Joe Gregorio        http://bitworking.org

Re: [Httplib2-discuss] 400 error when re-fetching certain pages

[Ross M K. <ros...@gm...>]

On 5/26/07, Ross M Karchner <ros...@gm...> wrote:
> If I run the program below twice, the first time it succeeds (200),
> and the second time it fails (400).

I forgot to add, I duplicated this with the current svn code, on OS X and Linux.

[Httplib2-discuss] 400 error when re-fetching certain pages

[Ross M K. <ros...@gm...>]

If I run the program below twice, the first time it succeeds (200),
and the second time it fails (400).

Is the issue httplib2, or Meetup's web server?

(it always succeeds if caching is off)

--------------

import httplib2

client=httplib2.Http('.testcache')
href="http://blog.meetup.com/99/calendar/ical/The+Washington+Blogger+Meetup/"

response, doc= client.request(href, 'GET')

print response

Re: [Httplib2-discuss] Optional non-'redirect following'

[Rene S. <re...@pt...>]

Right, not setting the header is the way to go.

My proxy simply reused headers it got from the browser, so normally, I 
would have to remove  'head : some.target.site' .. except that now, I 
can turn redirects of :-), and this becomes a non-issue!

Thanks for you support,
René

> Is there a particular reason you are manually setting the
> Host: header? Httplib2 does that for you automatically
> by pulling it out of the request URI.
>
> In general, I like to allow the user to set any header
> and have that override the default behavior, following
> the basic principle that the user knows best, but I'm open
> to the idea that that principle might break down
> on redirects.
>
>   Thanks,
>   -joe
>

Re: [Httplib2-discuss] Optional non-'redirect following'

[Joe G. <jo...@bi...>]

On 4/20/07, Rene Schmit <re...@pt...> wrote:
> Joe,
>
> I am probably completely wrong, but here is how I understand things:
>
> - redirects are made when the return status is 3xx
> - the redirect is made to the URI contained in the 'location' header
>
> When retrieving a page with httplib2, I get the final page of the chain,
> thus:
> status = 200
> headers: content-location=<<<new url, as you said>>>
> content of final page
>
> There is NO location field (which is correct for 200, no?). So, the
> browser (which is a client of my program) does not get a 3xx, and no
> 'location', so does not (and cannot) redirect based on 3xx/location. If
> I interpret RFC 2616 (14.14) correctly, the content-location MAY (not
> MUST) be used by the client, (uppercase here not used to shout, but
> RFC-style:-), and it seems that the three browsers I used to test
> (Firefox, Opera and Konqueror) consistently ignore it, and consequently
> fetch page content (images etc) from the wrong site. Switching of
> redirections solves the problem...

Ok, now that makes perfect sense. I have added a 'follow_redirects'
attribute to Http() and updated the documentation and unit tests, all
available on trunk.

> Here is another thing I saw while testing:
> when redirecting to another host name, the host header in the request is
> not modified. This causes a redirection loop. Example:
>
> import httplib2
> t='cnn.com'
> h=httplib2.Http(cache='/tmp/cache')
> h.force_exception_to_status_code = False
> r,o=h.request('http://%s/' % t,headers={'Host':t },)

Is there a particular reason you are manually setting the
Host: header? Httplib2 does that for you automatically
by pulling it out of the request URI.

In general, I like to allow the user to set any header
and have that override the default behavior, following
the basic principle that the user knows best, but I'm open
to the idea that that principle might break down
on redirects.

   Thanks,
   -joe

-- 
Joe Gregorio        http://bitworking.org

Re: [Httplib2-discuss] Optional non-'redirect following'

[Rene S. <re...@pt...>]

Joe,

I am probably completely wrong, but here is how I understand things:

- redirects are made when the return status is 3xx
- the redirect is made to the URI contained in the 'location' header

When retrieving a page with httplib2, I get the final page of the chain, 
thus:
status = 200
headers: content-location=<<<new url, as you said>>>
content of final page

There is NO location field (which is correct for 200, no?). So, the 
browser (which is a client of my program) does not get a 3xx, and no 
'location', so does not (and cannot) redirect based on 3xx/location. If 
I interpret RFC 2616 (14.14) correctly, the content-location MAY (not 
MUST) be used by the client, (uppercase here not used to shout, but 
RFC-style:-), and it seems that the three browsers I used to test 
(Firefox, Opera and Konqueror) consistently ignore it, and consequently 
fetch page content (images etc) from the wrong site. Switching of 
redirections solves the problem...


Here is another thing I saw while testing:
when redirecting to another host name, the host header in the request is 
not modified. This causes a redirection loop. Example:

import httplib2
t='cnn.com'
h=httplib2.Http(cache='/tmp/cache')
h.force_exception_to_status_code = False
r,o=h.request('http://%s/' % t,headers={'Host':t },)

Here, a redirection should be made to www.cnn.com, but the host header 
is never updated (inserting a header print into the lib shows this). 
Inserting the following:

 > headers['host'] = authority

right before  the redirection call in _request(...)

 > (response, content) = self.request(location, redirect_method ...

solves this problem (which is quite common, there are many sites that 
have 'alias' virtual host names that redirect to the 'primary' site name)

Thanks for your assistance,
René




Joe Gregorio wrote:
> Rene,
>    The 0.3.0 release of httplib2 adds a 'content-location' header
> to every response. That 'content-location' header contains
> the last URI in the redirect chain, which should be used
> on subsequent requests. Is that content-location not getting
> through back to the requester?
>
>   -joe
>
>
> On 4/19/07, Rene Schmit <re...@pt...> wrote:
>> Hello,
>>
>> I use the library in a proxy to retrieve pages from the target servers.
>>
>> In this context, the automatic redirect following is no good, as the
>> browser will not know about the redirect. Consequently, further requests
>> will be sent to the wrong host, resulting in errors.
>>
>> My solution to the problem is to add a flag to the Http class, in the
>> constructor:
>>
>> self.ignore_redirects = False
>>
>> and to change this line
>>  >       if  (self.follow_all_redirects or method in ["GET", "HEAD"]) or
>> response.status == 303:
>>
>> to:
>> <     if  (not self.ignore_redirects) and (self.follow_all_redirects or
>> method in ["GET", "HEAD"]) or response.status == 303:
>>
>>
>> Thus, the default behavior of the library remains unchanged, but gives
>> the calling code a chance to retrieve the 'raw' reply from the server.
>>
>> Does it make sense to add this feature to the library? What about
>> caching for those replies?
>>
>> René Schmit
>>
>> ------------------------------------------------------------------------- 
>>
>> This SF.net email is sponsored by DB2 Express
>> Download DB2 Express C - the FREE version of DB2 express and take
>> control of your XML. No limits. Just data. Click to get it now.
>> http://sourceforge.net/powerbar/db2/
>> _______________________________________________
>> Httplib2-discuss mailing list
>> Htt...@li...
>> https://lists.sourceforge.net/lists/listinfo/httplib2-discuss
>>
>
>