Re: [Themis-dev] Rewrite of HTML parser

[Mark H. <ma...@fi...>]

>Mark Hellegers wrote:
>> Hi Raymond,
>>
>> I have this week off from work, so I could spend to time to get the new
>> HTML parser into a usable state. Took quite a bit more effort than I
>> thought. :)
>>
>> I'm seeing some odd things though:
>> - On some sites I get the request to start parsing twice, bu the second
>> time I don't get any data. I built in a check in the parser to prevent
>the
>> second parse, but the second request shouldn't happen. I get this on
>> www.osnews.com for example.
>> - I don't get the complete data for themis.sf.net, although I can see
>that
>> the cache file does have all the data.
>>
>> I might look into it if I have the time, but getting the most serious
>bugs
>> out of the parser has a higher priority right now.
>>
>> Mark
>>
>>   It's probably something broken in either the HTTP add-on or in the
>message system... I think I noticed that with the old HTML parser as
>well, so I believe it's just been cleared of any wrong doing. :-) I'll
>see if I can dig into it either on Saturday or Sunday, just to make sure
>I properly clear your good name. :-)

Haha, that's no problem.
I checked in a number of changes over the weekend to make the parser a lot
better. It can actually parse quite a few of my test files and the chances
of getting into an infinite loop have been reduced quite a bit.
The problem with the data for a file doesn't seem to be in the cache
addon. I had a quick look and it does seem that the extra bytes are
actually stored in the cache.

I still have a few problems to fix in the parser, but for testing the rest
of Themis it is far enough I think.
I'd like to have a look at where the css support stands right now. That
might take a while as I don't know what exactly is there, but I'll report
back when I know what needs to be done.

Is it a good idea to have a chat on irc maybe next weekend or so, to
discuss what we want to do and maybe have a quick session of looking at
the most serious bugs that are currently in Themis ?

Mark

-- 
Spangalese for beginnners: