Re: [Jflex-devel] 1.7 release?
The fast lexer generator for Java
Brought to you by:
lsf37,
steve_rowe
From: Gerwin K. <kl...@un...> - 2016-03-13 11:40:03
|
Makes sense. Could you add these to the github tracker, please? 7) and 9) are no problem. 8) is interesting. I’d probably try to change the rules instead to avoid indefinite lookahead, but in a large grammar that might not make sense. In any case, it shouldn’t be hard to configure fixed buffers. This does change the semantics, though: in the Lucene case, the long rule never matches, but if the input was different, it could - and then the scanner with fixed buffer matches different tokens to the one with growing/unbounded buffer. I don’t think it’s a huge problem, but we should document it clearly. Cheers, Gerwin > On 13.03.2016, at 07:33, Steve Rowe <sa...@gm...> wrote: > > Hi Gerwin, > > Sorry I didn’t respond sooner on this. > > Your list looks good. > > There’s also: > > 7) Remove the option to generate an InputStream-param ctor (previously deprecated and slated for removal in 1.7). > > I have two new features I’d also like to include: > > 8) The ability to disable scanner buffer growth (the Lucene project hacks generated scanners to do this - see <https://issues.apache.org/jira/browse/LUCENE-5897> and <https://issues.apache.org/jira/browse/LUCENE-5400> for background.) > > 9) Reduce RAM usage of the char->char class map by using byte[] rather than char[] when the number of classes is less than 257 - see <https://issues.apache.org/jira/browse/LUCENE-6913>. This could be an automatic optimization, no option required. > > In addition to the latter two, I’ll take a look at 3, 4, 6, and 7. > > Steve > >> On Feb 28, 2016, at 3:25 AM, Gerwin Klein <kl...@un...> wrote: >> >> Looks more closely, these are the things we had marked for 1.7: >> >> https://github.com/jflex-de/jflex/milestones/release%201.7.0 >> >> 1) jflex --{version,info,help} should exit with code 0 >> 2) add previous JDKs to Tavis task >> 3) Warn for probably wrong unicode escapes such as \u0ffff enhancement >> 4) Make skeleton pass doclint enhancement >> 5) Upgrade to cup 0.11b task >> 6) Input/Output file encoding setting [sf#29] enhancement >> >> 1) is easy and I’ll have a look at it in the next few days. >> 2) can be moved to later, it needs test suite refactoring and is not that critical. >> 3) would be nice to have. >> 4) could be moved >> 5) just needs checking >> 6) would also be nice, but not critical. >> >> What do you think? >> >> Cheers, >> Gerwin >> >>> On 19.02.2016, at 18:59, Gerwin Klein <kl...@un...> wrote: >>> >>> I don’t have anything specific in my queue, so we could just move ahead. >>> >>> Bit pressed for time at the moment, let me see on the weekend what there is to do and if there is something that makes sense to do concurrently. >>> >>> Cheers, >>> Gerwin >>> >>>> On 19.02.2016, at 08:48, Steve Rowe <sa...@gm...> wrote: >>>> >>>> Hi Gerwin, >>>> >>>> The Lucene project is asking for Unicode 8.0 support from JFlex: <https://issues.apache.org/jira/browse/LUCENE-6993>. >>>> >>>> I committed Unicode 8.0 support in June 2015. >>>> >>>> Are there other things that should be included in a 1.7 release? >>>> >>>> If you agree that a release is a appropriate, is there anything I can do to help? >>>> >>>> Steve >>>> >>>> >>>> ------------------------------------------------------------------------------ >>>> Site24x7 APM Insight: Get Deep Visibility into Application Performance >>>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month >>>> Monitor end-to-end web transactions and take corrective actions now >>>> Troubleshoot faster and improve end-user experience. Signup Now! >>>> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 >>>> _______________________________________________ >>>> Jflex-devel mailing list >>>> Jfl...@li... >>>> https://lists.sourceforge.net/lists/listinfo/jflex-devel >>> >>> ------------------------------------------------------------------------------ >>> Site24x7 APM Insight: Get Deep Visibility into Application Performance >>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month >>> Monitor end-to-end web transactions and take corrective actions now >>> Troubleshoot faster and improve end-user experience. Signup Now! >>> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 >>> _______________________________________________ >>> Jflex-devel mailing list >>> Jfl...@li... >>> https://lists.sourceforge.net/lists/listinfo/jflex-devel >> >> ------------------------------------------------------------------------------ >> Site24x7 APM Insight: Get Deep Visibility into Application Performance >> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month >> Monitor end-to-end web transactions and take corrective actions now >> Troubleshoot faster and improve end-user experience. Signup Now! >> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140 >> _______________________________________________ >> Jflex-devel mailing list >> Jfl...@li... >> https://lists.sourceforge.net/lists/listinfo/jflex-devel > > > ------------------------------------------------------------------------------ > Transform Data into Opportunity. > Accelerate data analysis in your applications with > Intel Data Analytics Acceleration Library. > Click to learn more. > http://pubads.g.doubleclick.net/gampad/clk?id=278785111&iu=/4140 > _______________________________________________ > Jflex-devel mailing list > Jfl...@li... > https://lists.sourceforge.net/lists/listinfo/jflex-devel |