#40 Response encoding not recognized

[Nickolay Datchev]

when testing pages with non UTF- encoding, for
example cyrilic, the inner non-english texts are not
correctly parsed. Maybe some kind of encoding
recognition code should be added in
HttpClient.ReadHttpResponse. This should be using the
response.ContentType "charset=". and creating and
encoding to pass to StreamReader reader = new
StreamReader(response.GetResponseStream(),encode)