JFlex is a flex-like lexer generator for Java with emphasis on speed and full Unicode support. It has some not so usual features like negation in regexps and nested input streams. Also reads JLex specifications unchanged.
I am trying to regenerate the tokenizer by modifying the attached ClassicTokenizerImpl.jflex file using the command mentioned below. I am using JFlex 1.5 SNAPSHOT version, command used:
Command: java -jar d:\jflex-1.5.0\lib\jflex-1.5.0.jar ClassicTokenizerImpl.jflex
I observed a noticeable difference between the generated java file and the original java file available in lucene-core-3.6.0-sources.jar file. Please find the attached file for reference.
Am I missing some command line attributes while generating the java file.
Bhushan, please repost your question on the jflex-users mailing list. See http://jflex.de/mailing.html for more information.
Sign up for the SourceForge newsletter:
You seem to have CSS turned off.
Please don't fill out this field.