Re: [Flex-devel] Push-lexer

[Jerome H. <jer...@gm...>]

Hi all,

Please review https://github.com/westes/flex/pull/476 and give me your
opinion.
I can provide you with two files generated with the old and the new
version, so you can see the diffs, if it's easier than generating them
yourselves.

Cheers,
Jérôme.

On Sat, Feb 6, 2021 at 5:11 PM Mighty Jo <mig...@gm...> wrote:

> Understood. Sounds like you have a better handle on it than I do!
>
> -Joe
>
> On Sat, Feb 6, 2021, 11:04 Jerome Hamm <jer...@gm...> wrote:
>
>> Hi Joe,
>>
>> Thank you for your answer.
>> I might have missed something, but I didn't find any code that yields,
>> even with a reentrant lexer. bison returns YYPUSH_MORE. But for the lexer
>> interactive mode uses getc and processes the buffer as soon as it detects a
>> '\n', whereas non-interactive reads blocks. So if I'm not mistaken
>> interactive mode blocks on getc and does not yield.
>>
>> Cheers,
>> Jérôme.
>>
>> On Sat, Feb 6, 2021 at 3:29 PM Mighty Jo <mig...@gm...> wrote:
>>
>>> Hi, Jérôme!
>>>
>>> I'm not a maintainer, but they are pretty cool about considering pull
>>> requests. Add tests for any new functionality and be sure your fork passes
>>> 'make distcheck' when your tree has been cleaned with 'git clean -xdf'.
>>>
>>> If I may ask a silly question: Have you looked at the "interactive"
>>> scanner option? It's meant for reading from character devices. The
>>> differences are mostly invisible to the caller of yylex().
>>>
>>> I don't remember whether the interactive scanner yields or blocks when
>>> the input device is empty.
>>>
>>> Cheers!
>>> Joe
>>>
>>> On Sat, Feb 6, 2021, 08:12 Jerome Hamm <jer...@gm...> wrote:
>>>
>>>> Hi,
>>>>
>>>> I am working on the ability to push data byte by byte (or more, but not
>>>> necessarily aligned to tokens or complete lines) to flex, so platforms
>>>> which don't have threads, like micro controllers can also benefit from it,
>>>> in a "cooperative-multitasking" spirit.
>>>>
>>>> What is the policy about adding new functionality to flex, would this
>>>> be something that could be integrated?
>>>>
>>>> Cheer,
>>>> Jérôme.
>>>> _______________________________________________
>>>> Flex-devel mailing list
>>>> Fle...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/flex-devel
>>>>
>>> _______________________________________________
>>> Flex-devel mailing list
>>> Fle...@li...
>>> https://lists.sourceforge.net/lists/listinfo/flex-devel
>>>
>>